We are seeking an experienced Infrastructure Lead / Senior Software Engineer to help our client, a global multinational technology company, build and scale the internal systems that power large-scale data processing and operational workflows.
In this role, you will design and operate high-throughput data pipelines, distributed services, and internal tools that support teams working with complex datasets and high-volume task processing.
What You’ll Do;
Build Scalable Data Pipelines;
* Design and implement high-volume data processing pipelines that ingest, transform, and distribute large datasets.
* Develop systems that can prioritise, queue, and process work efficiently at scale.
* Ensure pipelines are reproducible, maintainable, and resilient to failure.
Design Platform Services;
* Build modular backend services and platform components that support evolving data workflows.
* Develop storage abstraction layers that allow services to interact with multiple underlying data systems.
* Implement mechanisms to ensure data consistency, deduplication, and integrity across distributed workflows.
Operate Production Infrastructure;
* Deploy and manage containerised workloads and batch processing jobs.
* Improve system reliability through fault tolerance, coordination mechanisms, and automated recovery processes.
* Work with infrastructure and security teams to ensure secure service communication and controlled data access.
Build Internal Tools & Automation;
* Develop tools that allow operational teams to ingest, manage, and analyse structured and unstructured datasets.
* Improve workflow efficiency by automating repetitive processes and enabling self-service data operations.
* Integrate platform services with internal tooling used by analysts and operational teams.
Drive Engineering Excellence;
* Establish engineering best practices for code quality, testing, and maintainable system design.
* Write clear documentation to support onboarding, system understanding, and operational troubleshooting.
* Implement monitoring and diagnostic tools to provide visibility into pipeline performance and system health.
Technical Skills;
* Strong programming experience, including a mastery of Python, as well as experience with similar backend languages.
* Experience building distributed systems or large-scale data pipelines.
* Solid knowledge of SQL and working with large datasets.
* Experience operating containerised infrastructure or production data platforms.
* Familiarity with service-based architectures and API-driven systems.
Experience;
* Several years of experience building backend infrastructure, data platforms, or internal tooling.
* Experience operating production systems handling large volumes of data or tasks.
* Comfortable collaborating across engineering and operational teams.
Nice to Have;
* Experience building internal platforms used by analysts, operations teams, or data specialists.
* Exposure to automation systems or AI-assisted tooling.
* Experience improving developer productivity or operational workflows through tooling.
* Background mentoring engineers or leading infrastructure initiatives.
Resources Global Professionals is a Worldwide Consulting Firm. Our model is unique and tailored to meet our consultants’ professional and personal goals. For more information about us, our clients and consultants and the professional services we provide, please visit www.RGP.com.