Role Overview
We are recruiting a BI & Databricks SME to support a major data and regulatory programme. This is a blended data modelling, data engineering, and BI development role — but with a clear requirement for someone who is an expert in Databricks. You will act as the senior Databricks specialist within the team, ensuring best‑practice modelling, engineering and transformation across multiple workstreams.
You will work collaboratively with analysts, architects, product owners and business stakeholders to design data models, build pipelines, develop reporting outputs, and deliver accurate, high‑quality datasets that underpin critical operational and regulatory oues.
What You’ll Be Doing
1. Leading on Databricks-based data engineering across multiple data sources.
2. Designing high‑quality data models, schemas, KPIs, measures and CDEs.
3. Building end‑to‑end data pipelines using Databricks, ADF and SQL.
4. Producing operational and regulatory datasets and reporting using Databricks and Power BI.
5. Applying rigorous data quality and dataernance standards to all development work.
6. Supporting BI development activities and contributing to the wider data product suite.
7. Providing guidance, coaching and SME‑level direction to analysts and technical colleagues.
8. Working within an Agile environment and collaborating closely with business stakeholders.
What You Must Have
Databricks SME (Essential)You must be able to demonstrate expert-level capability in:
9. Designing and buildingplex Databricks notebooks, Delta pipelines and transformations.
10. Optimising Databricks performance, data flows and modelling structures.
11. Acting as the go-to Databricks specialist within a project or programme environment.
Technical Skills
12. Advanced SQL skills including stored procedures andplex transformations.
13. Strong experience with Azure Data Factory (ADF) and ETL/ELT delivery.
14. Proven background in data modelling, schema design, KPI/CDE creation.
15. Working knowledge of Power BI, Report Builder and broader BI tooling.
16. Familiarity with Power Automate, Power Pivot, MS Teams and SharePoint.
17. Understanding of Azure Data Lake and dimensional modelling.
Business & Delivery Skills
18. Ability to influence, coach and work effectively with business and technical teams.
19. Strong analytical and problem‑solving abilities.
20. Experience working in Agile delivery environments.
What you'll get in return
21. 6 Month contract with view to extend
22. £400 - 450 per day rate
23. Hybrid working with 3 days on-site at Milton Keynes and 2 days working from home