Salary: £60,000 - 72,000 per year Requirements: 3 years of experience in data engineering or a similar role Strong experience with Databricks and Apache Spark Proficiency in Python and SQL Experience with Delta Lake, data modeling, and performance tuning Hands-on experience with cloud platforms (AWS, Azure, or GCP) Familiarity with data orchestration tools (e.g., Airflow, Azure Data Factory) Solid understanding of data warehousing and big data concepts Experience with real-time/streaming data (preferred) Knowledge of CI/CD for data pipelines (preferred) Experience supporting machine learning pipelines (preferred) Databricks or cloud platform certifications (preferred) Responsibilities: Design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and Delta Lake Build and optimize ETL/ELT workflows for batch and streaming data Develop data models to support analytics, reporting, and machine learning use cases Ensure data quality, reliability, and performance across data platforms Integrate data from multiple sources including APIs, databases, and cloud storage Collaborate with data scientists and analysts to enable advanced analytics and ML workloads Implement monitoring, logging, and cost-optimization best practices Follow data governance, security, and compliance standards Document data pipelines, architectures, and best practices Technologies: AI Airflow AWS Azure Big Data CI/CD Cloud Databricks ETL GCP Support Machine Learning Python SQL Security Spark Fabric Kafka More: We are seeking a skilled Databricks Data Engineer to join our team in a hybrid work environment. Our company specializes in Data & AI recruitment and we are committed to providing our team with the resources and support they need to succeed. We offer opportunities for professional development, and we pride ourselves on our collaborative team culture. last updated 5 week of 2026