MAIN PURPOSE:
The post holder will be part of the Analytics and Insight team. This is a crossfunctional data team who play a pivotal role in designing, implementing and maintaining data pipelines and infrastructure to support data-driven decision making and analytics initiatives.
MAIN DUTIES / RESPONSIBILITIES
1. Lead the design and implementation of industry standard data models and architecture in line with agreed plans and within agreed budget as directed and advised by the Lead Data Engineer.
2. Keep abreast of developments in data engineering technologies, tools and best practice and advise on their potential impact.
3. Use expertise gained to contribute to the development of policies and procedures for the implementation of solutions across the HSC.
4. Design, develop and maintain resilient, scalable data pipelines and ETL processes to ingest, transform and store data from diverse sources.
5. Utilise cloud services to build and optimise data pipelines.
6. Oversee the technologies, tools and techniques used within the team
7. Ensure appropriate support services are delivered to ensure the systems remain operational in accordance with its agreed specification and SLA.
8. Lead ongoing support, undertake investigations and recommend solutions to address issues.
9. Work with specialist advisors in legal and procurement services to successfully deliver the IT applications.
ESSENTIAL CRITERIA
10. A university degree, or professional qualification, relevant to ICT and have worked for at least 3 years in a data engineering role within a major organisation. OR
11. Have at least 5 years' experience in an ICT data engineering role
12. Demonstrate relevant specialist knowledge and experience in the following areas:
13. Building data pipelines
14. Infrastructure in a cloud environment, preferably Azure
15. Database and query design for reporting and analysis
16. Data extraction, transformation and loading concepts
17. Strong programming skills in Python or R with experience in data manipulation, transformation and analysis f. Gathering and documenting user requirements
18. Application of development standards, policies and procedures
19. Hold a current UK driving license