Senior Data Engineer | Peiriannydd Data Arweiniol
At Transport for Wales, we’re on a mission to transform transport in Wales and make it fit for the future, whether that’s rail, bus, walking or cycling. We want to inspire a nation to change the way it travels, so that we all travel more sustainably and help to combat the climate emergency we’re all facing.
We’re an open and inclusive place to work, where everyone is welcome and our people are supported to reach their full potential. We want to create an environment where our people can grow and succeed.
Role Responsibilities
The Senior Data Engineer will design, build, and maintain robust, scalable, and secure data pipelines and platform that enable Transport for Wales’ (TfW) to make data‑driven decisions.
* Drive the provision of a resilient and future‑ready data platform that underpins organisational growth, supports cross‑functional analytics, and enables data‑driven decision‑making by developing and deploying scalable data pipelines leveraging a Microsoft Azure‑first approach, utilising tools such as Fabric, Data Factory, Databricks, and Synapse Analytics.
* Implement robust data management practices focused on data domains, quality, and lineage by integrating data from multiple internal and external sources into a cohesive system to ensure that data is comprehensive, accurate, and traceable, supporting reliable business analysis and reporting.
* Design, implement, and optimise physical data models that align with pipeline architecture, using an approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource‑efficient data processing to meet the organisation’s evolving analytical and operational demands.
* Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processing, empowering stakeholders to make informed decisions based on high‑quality, processed information.
Who we’re looking for
* Degree or MSc in Computer/Data Science or Data Engineering or equivalent experience in data engineering, data management, or a related field.
* Proven experience in designing, building, and maintaining data pipelines using tools such as Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles.
* Experience of using programming languages such as Python, Scala and SQL and of data transformation, testing, and automation.
* Demonstrable knowledge of data modelling (star/snowflake schemas, dimensional models) and data warehousing within platforms such as Azure Synapse Analytics.
* Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud‑based architectures.
Welsh Language Skills
The ability to speak/write Welsh would make a great addition to your application, but it is not essential for this role. Transport for Wales supports and promotes the use of the Welsh Language by employees and will encourage them to develop, improve and maintain their Welsh Language skills.
Next steps
Does this role sound like the opportunity you are looking for? Do you want to find out more? See attached Job Description for further details.
Transport for Wales is a disability leader. We are happy to discuss any reasonable adjustments you may need in the recruitment process or as part of the role if you are successful.
This advert will close at midnight on the day of the application closing date stated above. We do encourage you to submit your application as early as possible. Please note, we reserve the right to close this vacancy early if we receive sufficient applications.
Note that you must hold the permanent right to work in the UK. We are not currently able to provide sponsorship.
#J-18808-Ljbffr