In this role, you will play a key part in building and maintaining robust data pipelines that support a modern, enterprise-scale data platform. You'll work closely with architects, analysts, and client stakeholders to ensure data is reliable, accessible, and aligned to architectural standards. You'll be trusted to take ownership of engineering outcomes, contribute ideas to improve platform performance and resilience, and help shape a positive, collaborative engineering culture.
Responsibilities
* Build & Deliver: Design, develop, and maintain scalable data pipelines using Databricks, Azure Data Factory, and Python.
* Ensure Quality: Maintain data quality, consistency, and lineage across ingestion, transformation, and delivery layers.
* Orchestrate & Monitor: Implement orchestration, scheduling, and monitoring to ensure reliable data operations.
* Collaborate & Align: Work with Data Architects and Analysts to align pipelines with data models and target architecture.
* Troubleshoot & Optimise: Resolve data issues across development and production environments to maintain platform stability.
* Document & Share: Maintain clear technical documentation and contribute to shared engineering knowledge.
* Support & Mentor: Coach and support team members, helping raise capability across the data engineering function.
To be successful, you will bring strong hands-on data engineering experience, a proactive mindset, and the ability to work collaboratively within agile teams. You should be comfortable taking ownership of data solutions, continuously improving them, and supporting others to succeed.
Qualifications
* Strong experience with Databricks, SQL, Azure Data Factory, and Python.
* Experience working within Azure-based data platforms.
* Proven background in building and maintaining scalable data pipelines.
* Experience with Azure DevOps and agile delivery practices.
* Solid understanding of data modelling and data architecture principles.
* Strong problem-solving, communication, and collaboration skills.
* Experience with CI/CD, version control, and DevOps practices for data.
* Desirable: Azure Synapse, Blob Storage, data quality/testing tooling, Git, or triplestore technologies.
Benefits
* Insurance coverage
* Medical benefits
* Pension plan
* Member Assistant Programme
* Check4Cancer
* Flexible time off
* Share Purchase Plan
* Member discounts
* Dental benefits
* Vision benefits
* Profit Participation Plan
* Health and Wellbeing Programme
#J-18808-Ljbffr