As a Lead Data Engineer at Next, you will be instrumental in designing, developing, and maintaining scalable data solutions within our Azure environment. You will be responsible for building robust data pipelines, ensuring data quality, and supporting our data science and analytics teams. This is a hands‑on role where you will be expected to lead by example, mentor junior engineers, and contribute to the overall technical strategy of our data platform.
Responsibilities
* Design, develop, and maintain scalable data pipelines and ETL processes using Azure services (e.g., Azure Data Factory, Azure Databricks)
* Ensure data quality, integrity, and security across all data platforms, implementing best practices for data governance.
* Collaborate with data scientists, business analysts, and other stakeholders to understand data requirements and provide necessary data infrastructure and solutions.
* Manage and optimize processes for performance, scalability, and cost‑efficiency.
* Mentor and guide junior data engineers, fostering a culture of technical excellence and continuous learning.
* Troubleshoot and resolve complex data‑related issues, ensuring high availability and reliability of data systems.
You’ll be doing all this from our Leicestershire Head Office. Our offices are inspiring, yes. But we understand that life happens. So, we’re big on making sure your work, works for you which is why we offer flexible working. Bring your energy. Play to your strengths. Make things bigger and better than before.
Qualifications
* Strong knowledge of Python, PySpark, and SQL, with extensive experience in developing and optimizing data pipelines.
* In‑depth knowledge and hands‑on experience with Azure data services, including Azure Databricks, Azure Data Factory and Azure Data Lake Storage.
* Experience with relational and NoSQL databases (e.g., Cosmos DB)
* Experience with building streaming data pipelines and Delta Live Tables using Pyspark/Databricks
* Strong understanding and working experience of building CI/CD pipelines using relevant tools (e.g., Azure DevOps, Git) for data solutions.
* Excellent problem‑solving skills and attention to detail.
* Strong communication and interpersonal skills, with the ability to collaborate effectively with cross‑functional teams.
Desirable Skills
* Knowledge of machine learning concepts and MLOps practices.
* Experience with other cloud platforms (AWS, GCP)
* Experience with data governance frameworks and tools.
So if you have proven experience within Data Engineering with great communication skills and the ability to translate business needs to technical requirements for building data engineering solutions, this is the place for you - and your career.
We are looking for a Lead Data Engineer to join our eCommerce Data team at NEXT. Based from NEXT Head Office in Leicestershire with a competitive salary range of £64,000 - £79,000 with great benefits! Let’s talk numbers. When it comes to UK retail, it’s hard to find a bigger name. We sell thousands of items an hour and are expanding our e‑commerce business by the second. For anyone in Tech, this is the place to learn. To grow. And to thrive. eCommerce Data provides the department and the business the means to see what is working and what is not by drawing data and analysing patterns of shopping on our site and in general.
#J-18808-Ljbffr