Requirements
Must have:
- 10 years of experience in data engineering/platform design - 8 years of hands-on experience with AWS data and DevOps services - Strong proficiency in Python - Expertise in AWS data services including Lake Formation, Glue, Athena, S3, IAM, and KMS - Advanced experience with Spark/PySpark - Proficiency in Terraform and GitHub Actions for CI/CD - Experience with multi-account AWS architectures and governance - Nice-to-have: Experience with Iceberg/Delta/Hudi, DMS, EMR tuning, data quality and lineage tools (Datahub), and exposure to regulated industries (Banking/Finance)
Responsibilities:
- Architect end-to-end AWS data platforms (S3, Lake Formation, Glue, Athena, EMR/Spark) - Design multi-account data governance, security, and access models - Develop scalable ETL/ELT pipelines using Python and PySpark - Implement Infrastructure as Code (IaC) using Terraform and CI/CD using GitHub Actions - Optimize data pipelines for performance, quality, and cost - Collaborate with security, data science, and analytics teams
Company:
We are seeking a highly experienced AWS Data Platform Architect to join our team in Milton Keynes. This is a 12-month fixed-term role with the flexibility of hybrid work (2-3 days in the office). In this role, you will be part of a dynamic team focused on building large-scale, secure data platforms on AWS. We offer a supportive work environment and opportunities for professional growth.