Azure Data Engineer - Permanent
London (Hybrid - 2 days onsite)
£70,000 per annum
Morgan Hunt is partnering with a public sector organisation in London to recruit an Azure Data Engineer on a permanent basis.
This is a key role focused on leading the implementation of data flows that connect operational systems with analytics and business intelligence platforms. You will design, build, and maintain the organisation\'s data infrastructure, ensuring large datasets are processed, stored, and accessed efficiently and securely.
The successful candidate will bring a strong grounding in data engineering best practices and data architecture, along with the ability to collaborate effectively across technical and non-technical teams to deliver high-quality, scalable data solutions.
Key Responsibilities
Design & Development
* Design, develop, and optimise ETL processes using Databricks
* Build robust data pipelines to extract, transform, and load data into data lakes and other storage solutions
* Implement best practices for data management, governance, and data quality assurance
Data Infrastructure
* Build and maintain scalable, secure, and well-structured data architectures
* Integrate multiple data platforms and tools to create a cohesive data ecosystem
* Monitor, troubleshoot, and resolve data pipeline issues to ensure high availability and reliability
Collaboration
* Work closely with data scientists, analysts, and stakeholders to understand requirements and deliver effective solutions
* Develop a strong understanding of business problems and data use cases
* Collaborate with IT, Digital, and DevOps teams to support deployment and integration
Innovation
* Stay up to date with emerging trends in data engineering, platforms, and big data technologies
* Continuously review, evaluate, and improve existing data processes
Essential Experience
* Advanced SQL skills
* Strong experience with Databricks, including Spark, Delta Lake, and MLflow
* Proven experience migrating SSIS to Databricks
* In-depth understanding of ETL/ELT processes
* Solid knowledge of data warehousing concepts and architectures
* Ability to design and deliver data models across multiple subject areas
* Experience implementing data governance, security, and compliance standards to ensure data accuracy and integrity
Morgan Hunt is a multi-award-winning recruitment business for interim, contract and temporary recruitment and acts as an Employment Agency in relation to permanent vacancies. Morgan Hunt is an equal opportunities employer. Job suitability is assessed on merit in accordance with the individual\'s skills, qualifications and abilities to perform the relevant duties required in a particular role.
#J-18808-Ljbffr