Full-time | Hybrid | London | Up to £95,000 + Bonus & Excellent Benefits |
Key Responsibilities:
1. Design, develop, and implement advanced data pipelines and ETL/ELT workflows using cloud-native services such as AWS Glue, Lambda, S3, Redshift, and EMR.
2. Act as a technical authority in cloud data engineering by mentoring colleagues and promoting best practices.
3. Collaborate cross-functionally with analysts, data scientists, and business stakeholders to translate data requirements into robust technical solutions.
4. Establish and enforce standards around data quality, validation, lineage, security, and governance.
5. Troubleshoot and resolve complex production issues and performance bottlenecks in data systems.
6. Develop and maintain CI/CD pipelines for data workflows leveraging tools like Jenkins.
7. Automate data ingestion, transformation, and loading processes to enhance operational efficiency.
8. Work closely with DevOps and Engineering teams to ensure seamless deployment and maintenance of data infrastructure.
9. Stay updated on emerging cloud computing and data engineering technologies to continuously improve team capabilities.
10. Lead small-scale projects or initiatives within the data engineering domain as needed.
Background & Experience:
11. Minimum of 7 years’ experience in data engineering roles with significant exposure to AWS cloud platforms.
12. At least 3 years functioning as a senior engineer or subject matter expert.
13. Strong Linux platform experience with proficiency in scripting and automation.
14. Solid background in designing and operating CI/CD pipelines; familiarity with Jenkins or similar tools.
15. Deep understanding of DevOps principles, data warehousing, data modeling, and data integration patterns.
16. Proficient in one or more programming languages such as Python, Scala, or Java, alongside SQL and NoSQL database experience.
17. Knowledge of data quality assurance techniques and governance frameworks.
18. Excellent analytical, problem-solving, and communication skills.
19. Desirable: Experience with containerization technologies (Docker, Kubernetes), data streaming platforms (Kafka, Kinesis), and business intelligence or visualization tools.
20. Familiarity with Agile methodologies is advantageous.
21. AWS certifications related to data analytics or architecture are highly preferred.
Please apply to the role if you are passionate about architecting scalable cloud data solutions and eager to contribute as a trusted expert in a collaborative, fast-paced environment.
#J-18808-Ljbffr