Locations: Croydon | Manchester | Sheffield | Southport | Liverpool (60% office attendance)
Salary: £62,109 plus allowance of up to £18,291 pending assessment
Advert Close: 11:44pm Thursday 19th February 2026
Home Office Digital designs, builds and develops services for the rest of the department and for government. Every year our systems support up to 3 million visa applications, checks on 100 million border crossings, up to 8 million passport applications and deliver 140 million police checks on people, vehicles and property.
Lead Data Engineers implement the Data Engineering vision set by the Principal Data Engineer. You’ll design and implement complex data flows, develop ETL processes and collaborate with teams to deliver data strategies. The role involves managing Data Engineering services, leading analytical projects and acquiring new data sources. You’ll work with various colleagues, including Data Architects, Database Administrators and Data Analysts, to establish and govern the enterprise Data strategy, ensuring alignment with organisational standards and objectives.
You’ll get to work with some of the largest and most varied datasets around, and benefit from a wealth of continuous professional development resources and career opportunities. You’ll play a key role in delivering joined-up, intelligent services that unlock the value from data and deliver better outcomes for the UK.
We are recruiting for multiple posts across two portfolios:
Lead Data Engineer x2 (DSA) - Data Services and Analytics (DSA) is the part of HO Digital which leads the build of data products to integrate data from multiple sources, and then deliver products for business intelligence, reporting and data science. DSA has the ambition to be one of the leading providers of insight services in UK Government and is currently growing significantly with over 300 colleagues, providing services to variety of functions within the Home Office.
These roles focus on delivering scalable cloud based data engineering by developing complex AWS data pipelines and high quality data models. With a large focus being DevOps automation with Terraform or AWS CloudFormation, Java based service support, Dynatrace monitoring integration, and managing CI/CD pipelines using Drone. You’ll also drive event driven architectures with Kafka and ensure reliable, well governed datasets that enable data driven decision making across the organisation.
Lead Data Engineer x 2 (EUC&C) – The End User Compute and Collaboration (EUC&C) team develops and delivers a range of Microsoft 365 solutions, including Teams, SharePoint, OneDrive, Power Platform, and Office applications. These tools support collaboration and productivity across the organisation.
We are establishing a new data capability to drive the adoption of data driven insights across the organisation’s product and service landscape. Working on end-to-end solutions in both AWS and Azure, using languages including Python, SQL, and PowerShell and orchestration platforms such as Glue and Fabric, you will lead the design, development, and maintenance of robust, scalable data pipelines. You’ll work closely with senior data colleagues and key stakeholders to shape and deliver EUC&C’s data vision.
Main responsibilities
Your main day to day responsibilities will be:
* Managing data sources in a way to improve data quality and conform them for analysis.
* Developing new data models and ETL processes, working collaboratively with the analytics team and mapping data to an appropriate matching data model.
* Exercising key stakeholder management skills in order to manage expectations, listen and interpret business needs, communicate progress and facilitate difficult conversations, while building a 'service culture' around data.
* Managing the performance of suppliers and the data team to improve capability, as well as creating the roadmap which balances immediate user needs with long-term investment.
* Developing processes to balance data availability, capacity and data archiving, while continually improving processes and efficiency in the acquisition and ingestion of data.
* Line managing staff, including coaching and professional development.
As a Lead Data Engineer in you’ll have a demonstrable passion for Data, with the following skills or some experience in:
* Effectively leading and managing teams, helping them deliver technical products and projects in data analysis, solution design and end user reporting.
* Advising on best practice IT programming and automation techniques and tools such as GIThub, GITLab or other source control software, Python, Java.
* Leading the use of Cloud Data technologies, solutions and future Cloud Data Strategies with experience using tools such as Azure Automation, Azure Data Factory, Azure DevOps, ServiceNow, AWS Lambda, AWS Glue, Redshift, Athena, EC2, IAM, MS Fabric Notebooks and APIs such as REST, GraphQL.
* Working with stakeholders to gather requirements and deliver findings.
* Presenting complex ideas and recommendations in a clear concise way to technical and non-technical audiences, and senior customers.
* Using tools such as industry standard ETL tools, network databases and scheduling and orchestration tools such as Azure Automation, Azure Data Factory, Azure DevOps, AWS. Also, Step Functions, MS Fabric Task Flows, MSSQL, OneLake, AWS S3, AWS Redshift.
Desirable criteria for DSA roles
* Strong analytical and problem-solving skills including troubleshooting data issues and optimising data processes.
* Experienced in DevOps automation and cloud engineering, delivering scalable infrastructure using Terraform and/or AWS CloudFormation.
* Hands‑on experience integrating Dynatrace monitoring is advantageous.
* Skilled in Java, supporting Java‑based services.
* Experience of managing CI/CD pipelines with Drone (or equivalent) and working with event‑driven architectures using Kafka.
Desirable criteria for EUC&C roles
* Leveraging modern programming languages, such as Python and PowerShell, to develop and deliver high-quality data development and engineering solutions.
* Architecting and delivering robust conceptual, logical, and physical data models to underpin scalable, business-driven data platforms.
* Advising on best practice IT programming and automation techniques and tools.
* A civil service pension with employer contribution rates of at least 28.97%.
* In‑year reward scheme for one‑off or sustained exceptional personal or team achievements.
* The ability to potentially adopt flexible working options that suit your work/life balance, plus the opportunity in future to take a career break.
* 25 days annual leave on appointment, rising with service.
* Eight days public holidays, plus one additional privilege day.
* 26 weeks maternity, adoption or shared parental leave at full pay, followed by 13 weeks statutory pay and a further 13 weeks’ unpaid, after qualifying service.
* Maternity and adoption support leave (also known as paternity leave) of two weeks full pay, after qualifying service.
* Paid leave for fostering approval processes, support when a child is substantively placed with you plus a foster to adopt policy.
* Support for guardians and kinship carers.
* Corporate membership of ‘Employers for Carers’ providing additional information and advice for carers, plus a ‘Carer’s Passport’ to discuss workplace needs and underpin supportive conversations.
* Time off to deal with emergencies and certain other unplanned special circumstances.
Please click on apply now to be directed to the full job advert and application portal
#J-18808-Ljbffr