Senior Data Engineer – Burton on Trent
£64-67k
x1 day per week on-site
(Sponsorship is not provided for this opportunity)
Please read the following job description thoroughly to ensure you are the right fit for this role before applying.
As a Senior Data Engineer, you will lead the development and optimisation of our customers Azure-based data platform, ensuring efficient, secure, and high-performing data services. You’ll design scalable pipelines and data models, champion data governance and best practices, and drive continuous improvement to enhance data quality and accessibility across the business.
Key Responsibilities
* Data Engineering: Design, build, and maintain Azure data pipelines using Data Factory, Databricks, and related services.
* Data Architecture: Develop and optimise scalable data models, warehouses, and lakes (Azure Synapse, Data Lake Storage).
* Governance & Security: Enforce compliance and data protection standards (GDPR, DPA) through robust security and governance practices.
* Automation: Implement CI/CD pipelines and Infrastructure as Code (Terraform, Bicep, ARM) via Azure DevOps.
* Performance & Monitoring: Optimise data systems for cost, performance, and reliability; proactively resolve platform issues.
* Collaboration: Work closely with analysts and data scientists, mentoring junior engineers and promoting best practices.
* Innovation: Explore new Azure technologies to enhance platform capabilities and analytics.
* Documentation: Maintain clear technical documentation and share knowledge across teams.
Skills & Experience
* Expert in Azure Databricks (Unity Catalog, DLT, cluster management).
* Strong experience with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs.
* Proficient in Python, Scala, C#, .NET, and SQL (T-SQL).
* Skilled in data modelling, quality, and metadata management.
* Experience with CI/CD and Infrastructure as Code using Azure DevOps and Terraform.
* Strong analytical, communication, and stakeholder engagement skills.
* Exposure to machine learning engineering is desirable.
Interested? Please submit your updated CV to Olivia.Yafai@crimson.co.uk for consideration.
Not interested? Do you know someone who might be a perfect fit for this role? Refer a friend and earn £250 worth of vouchers!
Crimson is acting as an employment agency regarding this vacancy