Robert Half Technology are assisting a market leading financial services organisation to recruit a Data Engineer on a contract basis - Hybrid working - London based
Looking for a highly skilled Data Engineer to join our growing data platform team. You will be responsible for designing, building, and optimising large-scale data pipelines and services that power analytics, reporting, and data-driven decision-making across the business. This role is heavily cloud-focused (AWS) and requires strong expertise in Python, Spark, and relational databases.
Role
1. Design, build, and maintain scalable, reliable, and high-performance data pipelines and workflows.
2. Develop clean, maintainable, and testable code in Python for data ingestion, transformation, and processing.
3. Optimise and fine-tune query performance on Aurora Postgres and other relational databases.
4. Architect and manage data solutions on AWS using serverless technologies such as Lambda, Glue, Glue Data Catalog, EMR serverless, and API Gateway.
5. Implement and manage large-scale data processing with Spark (Iceberg tables in S3, Gold layer in Aurora Postgres).
6. Collaborate with data scientists, analysts, and stakeholders to ensure data availability, accessibility, and reliability.
7. Design and maintain robust data models that align with business and financial domain requirements.
8. Ensure best practices for data security, governance, and compliance.
Profile
9. Strong Python development skills, with experience writing clean, extensible, and testable code.
10. Proven experience with relational databases (Aurora Postgres preferred), including performance optimisation.
11. Extensive AWS experience, particularly with serverless data engineering tools (Lambda, Glue, Glue Data Catalog, EMR serverless, API Gateway, S3).
12. Solid Spark experience with large-scale data pipelines and data lakehouse architectures (Iceberg format a plus).
13. Hands-on experience with data modelling and designing scalable data architectures.
14. Strong understanding of the financial domain (preferred but not mandatory).
15. Excellent problem-solving, communication, and collaboration skills.
Company
16. Market leading financial services organisation with offices in London
17. Hybrid working - London based
Salary & Benefits
The salary range/rates of pay is dependent upon your experience, qualifications or training.
Robert Half Ltd acts as an employment business for temporary positions and an employment agency for permanent positions. Robert Half is committed to diversity, equity and inclusion. Suitable candidates with equivalent qualifications and more or less experience can apply. Rates of pay and salary ranges are dependent upon your experience, qualifications and training.