Data Engineer, Azure
London/Hybrid
£competitive + bonus + excellent benefits
Azure, Fabric, Python
Data Engineer with extensive cloud experience is sought by thriving financial services organisation in the City of London. As part of the Central Data Platform team, you will take the lead in shaping and implementing data engineering best practices to be adopted by distributed data teams across the organisation.
Your focus will be on building a modern, secure, and flexible development environment that empowers engineers to deliver high-quality data solutions efficiently while remaining compliant with the company’s security policies and governance frameworks.
Responsibilities
* Work with Product Owners to establish product requirements.
* Design and develop observable and secure data pipelines.
* Source, integrate and clean data using medallion architecture.
* Create Lakehouses and Warehouses.
* Optimise data pipelines, processing workflows and Fabric warehouses for performance.
* Maintain Data Catalogue and ensure data duplication does not occur.
* Work with the DevOps team to establish CI/CD processes.
* Work with other members of the central platform team to monitor the Microsoft Fabric feature roadmap and integrate new features into the established eco-system.
Skills
* Minimum 5 years working in a cloud environment.
* Semantic Models
* Azure Data Factory
* Azure Synapse
* SQL Server
* Database Design
* Data Warehousing
* Datalake/Lakehouse
For a full consultation on this exciting new opportunity, get in touch with Arc IT today!