Salary: £40,000 - 70,000 per year Requirements:
* Extensive enterprise experience with Hadoop, Spark, and Splunk.
* Proficiency in object-oriented and functional scripting, particularly in Python.
* Skilled in handling raw, structured, semi-structured, and unstructured data (SQL and NoSQL).
* Experience integrating large, disparate datasets using modern tools and frameworks.
* Strong background in building and optimizing ETL/ELT data pipelines.
* Familiarity with source control and implementing Continuous Integration, Delivery, and Deployment via CI/CD pipelines.
* Experience supporting and collaborating with BI and Analytics teams in fast-paced environments.
* Excellent analytical and problem-solving abilities.
* Knowledge of agile methodologies such as Scrum or Kanban is a plus.
* Comfortable representing the team in standups and problem-solving sessions.
* Capable of driving the creation of technical test plans and maintaining records, including unit and integration tests, within automated test environments to ensure high code quality.
* Promote SRE (Site Reliability Engineering) culture by addressing challenges through data engineering.
* Ensure service resilience, sustainability, and adherence to recovery time objectives for all delivered software solutions.
Responsibilities:
* Lead and develop data engineering platforms.
* Collaborate with BI and Analytics teams to deliver data solutions.
* Build and optimize ETL/ELT data pipelines.
* Integrate large, disparate datasets using modern tools and frameworks.
* Ensure high code quality through technical test plans and records maintenance.
* Represent the team in standups and problem-solving sessions.
* Drive a culture of SRE by addressing data engineering challenges.
* Maintain adherence to recovery time objectives for software solutions.
* Work effectively with other engineers through pair programming.
Technologies:
* CI/CD
* ETL
* Hadoop
* Kanban
* NoSQL
* Python
* SQL
* Spark
* Splunk
More:
We are a leading organization located in Sheffield, inviting talented individuals to join our team. This contract role offers the opportunity to showcase your expertise in data engineering while working three days a week in the office. We value diversity and welcome candidates who can demonstrate the necessary competencies, regardless of their experience level. In addition to a competitive salary rate, we promote a collaborative environment that supports professional growth and embraces agile methodologies.
last updated 8 week of 2026