Salary: £45,000 - 55,000 per year Requirements: Strong commercial experience delivering end-to-end data engineering and automation solutions in complex environments Advanced SQL skills, including performance tuning and optimisation across large datasets Knowledge of Python or R for data processing or analytics Hands-on experience with data integration and ingestion tools such as Azure Data Factory and Databricks Proven experience in data modelling, data warehousing, and relational database platforms (e.g. MS SQL Server) Experience designing cloud-native and/or on-prem data solutions Exposure to automation and AI-enabled data processes, with awareness of LLM use cases within data workflows Experience working in Agile delivery environments (Scrum, Kanban, DevOps) Strong analytical and problem-solving skills, with the ability to translate complex data into meaningful insights Excellent communication skills, capable of working effectively with both technical and non-technical stakeholders Responsibilities: Designing, developing, and maintaining automated end-to-end data pipelines across cloud and on-premise source systems Delivering reliable data ingestion, transformation, and delivery processes using technologies such as Azure Data Factory, Databricks, SSIS, and SQL Reducing manual interventions through automation and standardisation, including data preparation, feature engineering, and training-data pipelines Preparing data models and datasets (DWH / Lakehouse) to support business intelligence, analytics, and operational reporting Monitoring and supporting live data pipelines, resolving issues in line with ITIL best practices, and implementing proactive alerting and self-healing mechanisms Identifying and implementing performance optimisations across data pipelines, queries, and reporting workloads Supporting data governance processes, including data archiving, masking, encryption, and versioning, with opportunities to integrate AI-driven automation Contributing to CI/CD processes for data pipelines, ensuring releases are tested, compliant, and deployed with minimal operational impact Collaborating with cross-functional and international teams to support aligned, scalable data operations Supporting the ongoing evolution and execution of the organisations data strategy Technologies: AI Azure Business Intelligence CI/CD Cloud Databricks DevOps Support ITIL Kanban LLM Python SQL SSIS Network More: We are a large, enterprise-scale organisation based in Milton Keynes, modernising our Data Analytics and Automation Platform. We offer a hybrid working model, with 3 days in-office weekly, and a competitive salary ranging from £45,000 to £55,000. In this role, youll join a dynamic team that fosters collaboration and innovation, ensuring our data solutions are reliable and scalable. last updated 4 week of 2026