Job Title: Databricks Platform Lead (Contract)
Location: Remote (UK-based)
Day Rate: Up to £525 p/d (Outside IR35)
Contract: 6-Month Rolling
We’re looking for a hands-on Databricks Platform Lead to join a global software vendor and take ownership of a modern data ecosystem, driving data engineering excellence, platform optimisation, and AI enablement. You’ll lead a team of 6+ engineers, set best practices, and ensure the Databricks platform is reliable, scalable, and cost-effective.
Key Responsibilities
* Lead, coach, and mentor data engineers, embedding modern AI-enabled practices.
* Own and optimise the Databricks platform (Delta Lake, Unity Catalog, MLflow, Databricks SQL, DBX tooling).
* Redesign and optimise data pipelines for scalability, performance, and cost efficiency.
* Champion Python engineering best practices (testing, CI/CD, code reviews, AI-assisted coding).
* Drive DataOps & MLOps adoption, ensuring observability, governance, and end-to-end product lifecycle management.
What We’re Looking For
* 5+ years in data engineering/platform roles, with 2+ years running Databricks at scale.
* Expert in Apache Spark, PySpark, Delta Lake, Unity Catalog, MLflow.
* Strong Python engineering background with modern CI/CD pipelines.
* Proven experience optimising Databricks for performance and cost.
* Track record of leading teams and influencing best practices.
Why Join?
* High-impact role: Shape and optimise a global Databricks platform.
* Cutting-edge practices: AI-assisted development, DataOps, and MLOps.
* Flexibility: Fully remote, UK-based contract.
* Rewarding terms: £525 p/d, outside IR35, with long-term extension potential.