Security Clearance: NPPV3 required (or eligible)
Rate: Competitive (DOE)
Start: ASAP / Flexible
Overview
We’re supporting a leading consultancy client delivering complex data platform and analytics programmes across regulated and public-sector environments. They’re looking to engage an experienced Senior Data Engineer to help design, build and scale modern cloud data platforms on Azure, with a strong focus on Databricks and modern lakehouse patterns.
This is a hands‑on delivery role within multi‑disciplinary teams, supporting clients moving from legacy or fragmented data estates towards scalable, cloud‑native platforms.
Key Responsibilities
* Design and build robust, scalable data pipelines and platforms on Microsoft Azure
* Lead hands‑on delivery using Databricks (PySpark / Spark SQL) for data engineering and transformation workloads
* Develop and maintain ingestion frameworks (batch and streaming) from a variety of source systems
* Contribute to lakehouse architecture patterns using ADLS Gen2, Delta Lake, and modern data modelling approaches
* Work closely with solution architects, analytics engineers and stakeholders to translate requirements into technical solutions
* Champion data quality, reliability, performance and security best practices
* Support CI/CD, automation and infrastructure‑as‑code approaches within data engineering workflows
* Provide technical leadership and mentoring within delivery teams where appropriate
Required Skills & Experience
* Strong commercial experience as a Senior Data Engineer on Azure
* Proven hands‑on delivery with Databricks (PySpark, Spark SQL, Delta Lake)
* Experience with core Azure services such as:
* Strong SQL and data modelling experience
* Experience building production‑grade data pipelines (batch and/or streaming)
* Comfortable working in agile delivery teams within consultancy or complex enterprise environments
* Experience working in public sector or regulated environments
* Familiarity with lakehouse architectures and modern data platform patterns
* Exposure to data governance, security and platform best practice
* Experience operating in environments requiring NPPV3 or similar clearance
Clearance
* Active NPPV3 clearance is required (or candidates must be eligible and willing to go through the process).
#J-18808-Ljbffr