Position Description:
As a Senior Data Engineer, you will design and lead the implementation of data flows that link operational systems, analytics & BI platforms. You will be part of the Data Services team, which handles ingesting, storing, maintaining and exposing a variety of datasets. These datasets are used by analysts and data scientists to generate insights and support decision-making.
The team is growing, and your role will involve bringing in new datasets, maintaining existing ones, and ensuring data is clean, accessible and high-quality
Your future duties and responsibilities:
-Ingest new datasets as needed by the business.
- Ensure all analytics-ready datasets are formatted clearly and meet high-quality standards.
- Investigate and resolve any defects or discrepancies in the datasets.
- Maintain the dataset catalogue and data dictionary so analysts/data scientists can easily find and use data.
- Perform any other tasks that help ensure the datasets are coherent, well-maintained and available for end-users.
Required qualifications to be successful in this role:
Communication
- Engage effectively with both technical and non-technical stakeholders.
- Lead discussions in multidisciplinary teams and handle differing viewpoints.
- Represent and advocate for the Data Services team externally.
- Data Analysis & Synthesis
- Profile data and analyse source systems.
- Present clear insights to support how data is used downstream.
Data Development & Integration
- Design, build and test large or complex data products.
- Look for ways to improve data by providing “conformed” (standardised) datasets.
- Choose and implement technologies that deliver resilient, scalable, future-proof data solutions.
Data Modelling
- Produce data models across multiple subject areas.
- Explain the rationale behind choosing specific models.
- Understand industry-recognised modelling standards and apply them appropriately.
Metadata & Data Management
- Ensure datasets are accompanied by appropriate metadata.
- Know tools and practices for metadata storage and usage.
- Oversee integrity, accessibility and searchability of data and metadata, and recommend improvements.
Problem Resolution (Data)
- Respond to problems in databases, data processes or data products as they arise.
- Monitor services to identify trends and take preventative action.
Programming / Build (Data Engineering)
- Use agreed standards and tools to design, code, test, document and refactor moderate-to-complex programs and scripts.
- Collaborate with others on specifications and reviews.
Testing
- Review requirements, define test conditions, identify risks and test issues.
- Apply manual and automated testing as needed, analyse and report results.
Technical Understanding & Innovation
- Understand core technical concepts relevant to the role and apply them with guidance.
- Stay aware of emerging trends, tools, techniques in data, and their impact on the organisation
Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This position is available in Gloucester.
Skills:
1. Data Analysis
2. Data Engineering
3. English
4. Python
5. SQLite