Job Description Role Title: Sr. Databricks Engineer
Location: Glasgow
Duration: 31/12/2026
Days on site: 2-3
MUST BE PAYE THROUGH UMBRELLA
Role Description:
We are currently migrating our data pipelines from AWS to Databricks, and are seeking
a Senior Databricks Engineer to lead and contribute to this transformation. This is a
hands-on engineering role focused on designing, building, and optimizing scalable data
solutions using the Databricks platform.
Key Responsibilities:
• Lead the migration of existing AWS-based data pipelines to Databricks.
• Design and implement scalable data engineering solutions using Apache Spark on
Databricks.
• Collaborate with cross-functional teams to understand data requirements and translate
them into efficient pipelines.
• Optimize performance and cost-efficiency of Databricks workloads.
• Develop and maintain CI/CD workflows for Databricks using GitLab or similar tools.
• Ensure data quality and reliability through robust unit testing and validation
frameworks.
• Implement best practices for data governance, security, and access control within
Databricks.
• Provide technical mentorship and guidance to junior engineers.
M...