We are looking for a Senior Databricks Engineer with SC Clearance.
Responsibilities
* Design, build, and optimise end-to-end data pipelines using Azure Databricks, including Delta Live Tables.
* Collaborate with stakeholders to define technical requirements and propose Databricks-based solutions.
* Drive best practices for data engineering.
* Help clients realise the potential of data science, machine learning, and scaled data processing within Azure / Databricks ecosystem.
* Mentor junior engineers and support their personal development.
* Take ownership for the delivery of core solution components.
* Support with planning, requirements refinements, and work estimation.
Skills & Experience
* Proven experience designing and implementing data solutions in Azure using Databricks as a core platform.
* Hands‑on expertise in Delta Lake, Delta Live Tables and Databricks Workflows.
* Strong coding skills in Python and SQL, with experience in developing modular, reusable code in Databricks.
* Deep understanding of lakehouse architecture, with a solid grasp of data warehousing, data lakes, and real‑time data processing.
* Familiar with Azure Data Factory, Azure Synapse Analytics, and Microsoft Fabric.
* Good experience with CI/CD practices and tools for data platforms using Azure DevOps.
* Good knowledge on how to leverage AI to increase deployment productivity and quality.
* Excellent communication skills.
* Desirable: certification in Databricks Data Engineer and/or Azure Data Engineer are a plus.
Additional Information
* Rate offered: £500‑550 per day
* IR35 Status: Outside
* Location: Hybrid with travel to client site in the North East
* Start date: January
* Duration: 3 months initial sign‑up with significant opportunity for extension
* Required: Active SC Clearance
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Engineering and Information Technology
Referrals increase your chances of interviewing at ShareForce by 2x
#J-18808-Ljbffr