Salary: £9,750 - 10,400 per year Requirements: We require strong expertise in Azure data services, including ADLS, ADF, Databricks, Synapse, Event Hub, and Kafka. We require hands-on experience with Python, SQL, and Spark/PySpark. We require experience with data modeling, metadata, and lineage tooling, as well as performance and cost optimization. We require proven leadership experience managing engineering teams. We require experience working in Agile and DevOps environments, including CI/CD and test automation. We require exposure to energy trading systems such as ETRM or Endur, market data sources such as ICE, Platts, or Bloomberg, and SAP. We require a degree in Computer Science, Engineering, or equivalent practical experience. Azure Data Engineer or Databricks certifications are desirable. Responsibilities: We will lead the data acquisition function by defining ingestion strategy and scalable batch and streaming data patterns. We will design and deliver Azure-based data pipelines and platform solutions. We will standardize connectors, schemas, controls, CI/CD, infrastructure as code, and automated testing. We will lead onboarding of enterprise and market data sources, ensuring service levels and observability are in place. We will partner with Product Owners, Architects, and business stakeholders on data design and governance. We will act as the domain Data Manager for lineage, metadata, quality, access, and master data ownership. We will ensure compliance with data lifecycle, audit, records management, and governance standards. We will drive engineering best practices, operational excellence, and continuous improvement. We will manage capacity planning, skills development, and vendor contributions. We will translate end-user requirements into scalable engineering solutions for Trading, Risk, Finance, and Operations. Technologies: Azure CI/CD Databricks DevOps Kafka Marketing Python PySpark SAP SQL Spark Cloud More: We are a hiring company based in London offering an initial contract through to the end of the year, with onsite working required three days per week. We are looking for a Data Engineering Lead to help shape and deliver reliable, compliant, and high-value data solutions across Trading, Risk, Finance, and Operations. In this role, you will join a team focused on data governance, engineering excellence, and scalable Azure-based solutions. We also work with businesses across the UK in Finance, Marketing, IT, and Engineering, and we are committed to helping people find roles where they can make an impact and grow their careers. last updated 19 week of 2026