Job Description
Data Engineer (Azure/ETL/Data Platform) - Hybrid Clearance: NPPV3 preferred We have a requirement for a Data Engineer to join a growing data function, supporting the design, build and optimisation of a modern data platform. You will be responsible for developing scalable data pipelines, ETL processes, and data integration solutions, enabling high-quality data to drive analytics, reporting, and business insight. This is a hands-on role working closely with data analysts, BI developers, and stakeholders to deliver reliable, efficient, and secure data solutions. Key Responsibilities Data Engineering & Pipeline Development
* Design, build, and maintain scalable ETL pipelines
* Develop robust processes to extract, transform, and load data from multiple sources
* Optimise data pipelines for performance, reliability, and scalability
* Write and maintain ETL scripts to support data integration and analytics
Data Integration & Management
* Combine and structure datasets to enable insight generation and analytics
* Clean, transform, and store data to maximise usability and value
* Automate manual data processes to enable repeatability and efficiency
Collaboration & Stakeholder Engagement
* Work with stakeholders to understand data requirements and translate into technical solutions
* Collaborate with analysts and BI developers to support reporting and visualisation
* Provide guidance on effective use of data infrastructure
Data Quality & Governance
* Implement data quality checks, validation, and cleansing processes
* Ensure data accuracy, integrity, and consistency
* Adhere to data governance, privacy, and security standards (eg GDPR)
* Support data anonymisation and secure data handling
Support & Troubleshooting
* Diagnose and resolve data pipeline and dataset issues
* Ensure timely delivery of high-quality data
* Monitor and improve pipeline performance
Documentation & Best Practice
* Document data flows, pipelines, and technical processes
* Contribute to development of data engineering standards and best practices
Continuous Improvement
* Stay current with modern data engineering tools and technologies
* Recommend improvements to tooling, processes, and architecture
Essential Skills & Experience
* Strong experience in data engineering and ETL pipeline development
* Proficiency in SQL and at least one Scripting language (Python or R)
* Experience working with large and complex datasets
* Strong understanding of relational databases and data structures
* Experience integrating and transforming data from multiple sources
* Knowledge of data governance, security, and compliance
* Strong analytical and problem-solving skills
* Excellent communication and collaboration skills
Desirable Skills
* Experience with Azure Data Factory, Synapse, or similar ETL tools
* Familiarity with cloud platforms (Azure or AWS)
* Exposure to Power BI or data visualisation tools
* Experience building automated testing for data pipelines
* Public sector or regulated environment experience
Additional Requirements
* NPPV3 clearance preferred
* Eligibility/willingness to undergo security clearance