Job description
Data Engineer
Location: Warwick, UK (office based)
Day Rate: Market rate (Inside IR35)
Duration: 6 months
Role description
This role is for an experienced Azure Data Engineer to support the design, development and optimisation of data solutions within a modern cloud-based environment. The successful candidate will contribute to building scalable and reliable data pipelines, enabling data-driven decision-making across the organisation.
Working within a fast-paced delivery environment, the role offers exposure to cloud technologies and advanced data platforms, supporting the transformation and integration of large and complex datasets. The position plays a key role in ensuring data quality, accessibility and performance across business-critical systems.
Key responsibilities
1. Design, build and maintain scalable data pipelines using Azure data services
2. Develop and manage data integration workflows using Azure Data Factory
3. Perform data transformation and processing using tools such as Databricks and Python
4. Troubleshoot and debug data pipelines to ensure reliability and performance
5. Collaborate with stakeholders to understand data requirements and translate them into technical solutions
6. Optimise data storage and processing using platforms such as Snowflake
7. Ensure data quality, governance and security standards are maintained
8. Support deployment and monitoring of data solutions in production environments
9. Document data processes and maintain technical documentation
Key skills, knowledge and experience
10. Strong experience with Azure data services, including Azure Data Factory
11. Advanced expertise in Azure Data Factory development and optimisation
12. Experience working with Snowflake for data warehousing solutions
13. Hands-on experience with Databricks for large-scale data processing
14. Proficiency in Python for data engineering tasks
15. Strong SQL knowledge and experience working with relational databases
16. Experience in debugging and resolving data pipeline issues
17. Understanding of data architecture and best practices in data engineering
18. Good communication skills with the ability to work collaboratively
Desirable skills, knowledge and experience
19. 6 to 8 years of relevant data engineering experience
20. Exposure to additional cloud data platforms or modern data stack tools
21. Experience working in agile delivery environments