Salary: £18,000 - 19,500 per year Requirements: 2–3 years of strong, hands-on Databricks experience, including having led implementations from setup through to production. Demonstrable track record of delivering greenfield or ground-up data platform builds. Strong Python skills for data transformation and orchestration. Deep understanding of modern data architectures, pipelines, and cloud-native solutions – especially AWS. Able to operate strategically (architecture, direction-setting) and tactically (hands-on engineering). Active SC Clearance (must be current). Responsibilities: Act as the technical lead for a new Databricks implementation, working from greenfield through to full production deployment. Own and deliver streaming and batch data pipelines in Databricks for complex, sensitive use cases. Define and set architectural standards and delivery roadmaps for the data platform. Lead PoCs with hyperscalers to assess and select appropriate data services and tooling. Collaborate with engineering teams, stakeholders, and partners to ensure scalability, performance, and compliance. Document best practices, decisions, and technical architecture to support future scaling and handover. Technologies: AWS Architect Cloud Databricks Support Python More: We are a dynamic team supporting a critical greenfield transformation programme in the public sector. Our goal is to build a modern data platform that meets the needs of our stakeholders and partners. We look for a hands-on Lead Data Engineer/Architect with deep Databricks expertise to drive this initiative from start to finish. Our environment is highly visible, and we value collaboration and innovation. This role provides an excellent opportunity to make a significant impact within a supportive team. We also offer competitive benefits and a commitment to professional development. last updated 5 week of 2026