Locations: Bristol, Canary Wharf, Cardiff, Leeds, Manchester, Newcastle‑upon‑Tyne
We’re looking for a Senior Data Engineer to help modernise and strengthen our data platforms, using technologies such as Azure Databricks, and to play a key role in delivering trusted data for advanced analytics, MI and decision‑making.
The role
This position sits within the Information, Data & Analysis (ID&A) directorate, part of HMRC’s Data Analytics Platform (DAP).
With the introduction of Databricks as our core data engineering technology, this is an exciting time to join. You’ll work in the Analytical Data Engineering team, building and maintaining data pipelines that support advanced analytics and MI/BI across the Valuation Office.
Upcoming work includes developing a new framework for data ingestion, transformation, quality testing and monitoring on a new Databricks platform.
Why this role matters
As a Senior Data Engineer, Your Work Will
* Enable high‑quality analytics that inform policy, operations and funding
* Improve the reliability, quality and accessibility of valuation data
* Support analysts and decision‑makers with trusted, well‑governed data
* Help modernise how HMRC Valuation Office uses data at scale
What You’ll Be Doing
* Collaborate with analysts to define data requirements for advanced analytics
* Lead the development and maintenance of robust, scalable data pipelines
* Build solutions using Azure Databricks and established data engineering frameworks
* Implement and manage code changes through DevOps pipelines
* Develop and maintain data quality checks and monitoringProduce and maintain clear technical documentation
* Support reliable, stable production environments
* Guide technical decisions, explaining trade‑offs and recommending approaches
Who We’re Looking For
We’re looking for someone who brings both technical strength and a genuine desire to make a difference.
Essential Experience Includes
* Designing and building resilient data engineering solutions and ETL processes
* Strong experience with Python and SQL
* Data modelling to meet analytical and business needs
* Data profiling and source‑system analysis
* Diagnosing and resolving data issues in live environments
* Communicating effectively with technical and non‑technical stakeholders
* Confidence guiding decisions and making evidence‑based recommendations
#J-18808-Ljbffr