Role Overview
Energy Jobline is the largest global Energy Job Board with over 7 million professionals. We are recruiting for a pivotal opportunity to join the Data and Innovation division of a large complex organisation leading the delivery of the Supervisory Analytics and Metrics (SAM) program.
As Data Engineering Lead, you will architect and implement cloud‑data solutions aligned with the organisation’s enterprise cloud strategy and SAM’s Target Operating Model.
Responsibilities
* Define and implement the data engineering strategy aligned with business and technology goals.
* Lead development of data ingestion, quality, and metadata pipelines powering SAM’s supervisory tools.
* Deliver scalable, secure, and production‑ready data platforms using Azure and Databricks.
* Collaborate across Technology and DAT to integrate SAM solutions into the organisation’s Enterprise Data Platform (EDP).
* Champion CI/CD, DevOps, data governance and federated development within the PRA’s Hub & Spoke model.
* Mentor and coach data engineers on Azure tooling, pipeline management, coding practices, and design principles.
* Work with data governance teams to maintain a comprehensive data catalogue and ensure compliance with security and privacy regulations.
* Contribute to Communities of Practice and support the cloud‑first strategy.
Qualifications
* Extensive experience in cloud‑based data engineering (preferably Databricks), with a strong background in modernization and large‑scale migration.
* Expertise in Azure services (API Manager, App Service), Databricks, Spark, Python, SQL, and AI/ML frameworks.
* Proven track record of leading technical teams and delivering complex data solutions in production.
* Strong understanding of data governance, security, and compliance in regulated environments.
* Proven experience designing and deploying cloud‑data architectures at scale.
* Proficiency in Python, SQL, PySpark.
* Demonstrated ability to build secure, scalable, cost‑efficient data solutions on Azure.
* Experience with data security and regulatory compliance tools (e.g. Microsoft Purview, Unity Catalog).
* Experience designing and implementing AI/ML‑driven solutions within data platforms.
* Relevant certifications (e.g. Databricks Engineer Professional, Azure Data Engineer Associate, Azure Solutions Architect).
* Advanced academic qualifications or industry recognition in data engineering and cloud technologies.
* Experience in DevOps practices using GitHub Actions and automated CI/CD pipelines.
Benefits & Compensation
Salary negotiable on experience up to £90,000 plus excellent benefits package including generous annual leave, pension and hybrid working.
Based in Leeds with flexible working arrangements.
How to Apply
If you are interested in this role, click ‘apply now’ to forward an up‑to‑date copy of your CV, or call us now.
Energy Jobline wishes you the very best of luck in your next career move.
#J-18808-Ljbffr