Job Description
Data Engineer | Hybrid | Pontypridd
IntaPeople are proud and excited to be appointed to recruit an experienced Data Engineer for a Welsh-based not-for-profit sector client on an exclusive growth project.
This is a very exciting opportunity to join their fast-growing Data/IT function in this newly created position. You will be joining the data team as one of the first employees in this area of the business which will work with external partners to build out the organisations data capability offering. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining robust, scalable, and secure data pipelines and platform that enable them to make data -driven decisions.
In this newly created role you’ll work closely with the ‘Head of Data Engineering’ to grow out this data function with the recruitment of further data engineering colleagues. You will also get the opportunity to progress into a leadership role if this suited the individuals’ desires and capabilities. You’ll be exposed to a wide range of projects that include internal and external suppliers, with annual budgets spreading from £1M- £2M+.
Essential Skills
* Proven experience as a Data Engineer (or similar/related role)
* Experience with Azure Data Factory, Databricks, or Apache Spark, following modern ETL/ELT principles.
* Experience of using programming languages such as Python, Scala and SQL.
* Demonstrable knowledge of data modelling and data warehousing within platforms such as Azure.
* Practical experience with Microsoft Azure services, including Azure Data Lake (Gen2), Synapse, Event Hubs, and Cosmos DB, within scalable cloud -based architectures.
* Experience in using Git, Azure DevOps, or GitHub Actions for version control, CI/CD, and collaborative data delivery.
* Robust understanding of data governance, data quality, and metadata management.
* Experience of communicating technical information and data to a non-technical audience and working collaboratively with analysts, architects, and product owners to deliver data solutions that meet user and organisational needs.
Key Responsibilities (at a glance):
* Lead on the introduction of foundational data management capabilities to improve trust, accessibility, and efficiency in an organisation that has limited data management capability, lacks data management practices, including governance, metadata standards, and quality controls.
* Design, implement, and optimise physical data models that align with pipeline architecture, by using the approach that ensures efficient query performance, scalable storage, and robust integration and delivers adaptable and resource -efficient data processing, meeting the organisation’s evolving analytical and operational demands.
* Work closely with data analysts, architects, DevOps Engineers, and business stakeholders through regular communication and collaborative planning to ensure data solutions are closely aligned with business objectives and effectively meet user needs.
* Transform raw data into meaningful insights by developing and maintaining tailored ETL (Extract, Transform, Load) processes enabling customised processes, empowering stakeholders to make informed decisions based on high-quality, processed information
* Managing the aspirations of a variety of stakeholders to enable successful project delivery can be challenging, especially when their priorities may differ or even conflict and require reconciliation to meet business and project needs.
What you’ll get in return (at a glance)
1. A salary of circa £52,000 - £56,000 (depending on experience)
2. 28 days annual leave + public