ETL Data Engineer/Data Architect - Azure Stack
We are looking for an experienced ETL Data Engineer/Data Architect to deliver projects in collaboration with our IT partners and internal stakeholders that will transform our product landscape.
Responsibilities
- Deliver data pipelines or products that support our business operations and research, providing clear documentation on specifications and having a deep understanding of each solution at the data, technical and business process levels.
- Implement data engineering best practices to standardise the development process.
- Design and maintain data integration frameworks for multiple data sources such as practice management systems, lab systems, registries.
- Be responsible for ensuring that high quality data is presented from the products to our researchers, and data dictionaries are maintained in the data catalogue.
Essential Qualifications
- Educated to degree level in a relevant IT subject.
- Expertise in designing and implementing data pipelines using Azure services (Azure Data Factory, Data storage), Spark and Databricks.
- Expertise in data modelling, database design and designing enterprise data architecture.
- Azure Data Stack: SQL Server, NoSQL, Nanobricks, ADT, Spark, Data Tables, API, PostgreSQL.
- Knowledge of ETL/ELT frameworks and data integration patterns with programming experience in Python or PySpark.
- Data modelling experience.
- Experience working with product teams.
- Ability to collaborate and communicate with stakeholders and product managers.
Desirable Qualifications
- Experience in the life sciences sector.
- Experience working with structured and semi-structured data, preferably having worked previously with a variety of life science data such as omics, health records.
The role offers hybrid working with only one day a week required on site near Nottingham.
