Job Title: Data Engineer
Job Description
We are seeking an experienced Data Engineer to support a major data transformation initiative for a large financial services client. This role involves modernizing legacy data platforms, building scalable cloud-based pipelines, and ensuring secure, compliant delivery within a regulated environment.
The ideal candidate brings strong hands-on engineering capability, understands the complexities of large enterprises, and can work effectively with technical and business stakeholders.
Key Responsibilities
1. Design, build, and optimize scalable data pipelines and ETL workflows.
2. Develop high-quality SQL for data modelling, transformation, and validation.
3. (Expert-level SQL is mandatory)
4. Use Apache Airflow to orchestrate and manage complex pipelines.
5. Support migration initiatives from legacy on-prem systems into AWS.
6. Work with AWS services including EMR, S3, Lambda, EC2, and other foundational components.
7. Collaborate with data architects, business analysts, and project stakeholders.
8. Use Git for version control, CI/CD workflows, and structured development practices.
9. Optional: Contribute to Snowflake-based warehousing and analytics workloads.
Required Skills & Experience
10. Strong SQL development and optimization skills (must-have).
11. Hands-on Experience with Airflow for pipeline orchestration.
12. Practical Experience with AWS EMR and relevant AWS services.
13. Experience in data migration from legacy platforms to AWS.
14. Familiarity with Git and collaborative development methodologies.
15. Strong communication skills with the ability to engage stakeholders across technical and business teams.
16. Experience working in regulated industries (financial services preferred).
Desirable Skills
17. Experience with Snowflake.
18. Exposure to large-scale data platforms in enterprise environments.
19. Understanding of data governance, security, and regulatory standards (, GDPR, FCA, SOX).
Key Technologies
20. SQL
21. AWS (EMR, S3, Lambda, EC2)
22. Airflow
23. Snowflake (advantageous)
24. Git
25. Stakeholder Management
Location
Edinburgh, UK
Trading as TEKsystems. Allegis Group Limited, Maxis 2, Western Road, Bracknell, RG12 1RT, United Kingdom. No. 2876353. Allegis Group Limited operates as an Employment Business and Employment Agency as set out in the Conduct of Employment Agencies and Employment Businesses Regulations 2003. TEKsystems is a company within the Allegis Group network of companies (collectively referred to as "Allegis Group"). Aerotek, Aston Carter, EASi, Talentis Solutions, TEKsystems, Stamford Consultants and The Stamford Group are Allegis Group brands.