Job Description
Job Title: Data Engineer (Databricks)
Location: Remote (once a month, Derby)
Employment Type: 6-month Contract
Rate: Market Rate (Outside IR35)
About the Role:
I’m looking to speak with an experienced Data Engineer to support a major data platform modernisation, centred around Databricks. You’ll play a key role in migrating data from legacy/on-premise systems to a modern cloud-based analytics platform, building scalable data pipelines and robust data models to support reporting and advanced analytics.
This role will involve hands-on engineering across the full data lifecycle — from ingestion and transformation through to modelling and optimisation — working closely with analytics, reporting, and business stakeholders.
Key Responsibilities:
1. Design, build, and maintain data pipelines using Databricks (Spark / PySpark / SQL).
2. Support the migration of on-premise data sources to a cloud-based Databricks platform.
3. Develop and optimise data models (e.g. dimensional, star schema, or medallion architecture).
4. Implement best practices for Delta Lake, performance tuning, and cost optimisation.
5. Identify and resolve data quality, reliability, and performance issues during migration...