Position
Senior Data Engineer at Severn Trent. Based at the Severn Trent Centre head office in Coventry. Working 37 hours a week, Monday to Friday.
Key Accountabilities
* Databricks pipeline engineering: Design, build and operate Spark pipelines on Databricks, including handling schema evolution, incremental loads, backfills, and failure recovery.
* Integration and orchestration (IDMC): Use Informatica IDMC to implement governed, repeatable ingestion patterns from source systems into curated lakehouse layers.
* Lakehouse modelling: Build curated bronze, silver and gold datasets that are performant, testable, and fit for downstream analytics and data products.
* Data quality and reliability: Implement automated data quality checks, validations and controls that prevent bad data from silently reaching consumers.
* Performance and cost optimisation: Actively tune Spark workloads, storage layouts and execution patterns with an awareness of cloud cost and runtime behaviour.
* Dual‑run and migration delivery: Support and stabilise existing Synapse workloads while contributing to migration and net‑new delivery on Databricks.
* Technical leadership: Set engineering standards through code reviews, patterns and practical mentorship rather than documentation alone.
Experience and Skills
We are looking for engineers who are genuinely strong at data engineering as a craft, not generalists who have only used platforms at a surface level.
* Strong experience building PySpark‑based pipelines that run reliably in production.
* A solid grasp of Spark execution behaviour, including partitioning, shuffles, joins and performance trade‑offs.
* Hands‑on experience with Databricks in a real delivery environment.
* Experience using Informatica IDMC or equivalent enterprise integration tooling to build governed ingestion flows.
* Strong SQL skills and confidence working across raw, curated and consumer‑ready data layers.
Experience operating or supporting Azure Synapse is useful during the transition, but it is not the long‑term focus of the role.
Benefits
* 28 days holiday + bank holidays (and the ability to buy/sell up to 5 days per year)
* Annual bonus scheme (up to £2,225, subject to eligibility)
* Family‑friendly policies (including a year off fully paid maternity and adoption leave)
* Leading pension scheme – we will double your contribution (up to 15% when you contribute 7.5%)
* Sharesave – the chance to buy Severn Trent plc shares at a discounted rate
* Dedicated training and development with our Academy
* Electric vehicle scheme and retail offers
* Two paid volunteering days per year
J-18808-Ljbffr