Senior Data Engineer – Azure
** 5 days a week onsite - Central London **
£70,000 - £80,000 per annum
About the Role
One of the UK’s leading insurers are looking for a Senior Data Engineer with a primary focus on Azure to lead the design and implementation of scalable, enterprise-grade data solutions. This role will play a key part in building real-time and ETL/ELT data pipelines, maintaining and optimising our data warehouse, and delivering advanced analytics through Power BI.
You will also contribute to innovative AI-driven solutions, including the development of AI agents for post-sales call auditing, leveraging OpenAI’s APIs.
This is a stand-alone, hands-on role based onsite in Central London, working closely with cross-functional teams to drive data and AI initiatives that directly support business outcomes.
Key Responsibilities
* Design and implement scalable, robust real-time data pipelines integrating diverse data sources (APIs, databases, flat files).
* Build, maintain, and optimise a high-performance data warehouse to support reporting, analytics, and AI workloads.
* Develop interactive Power BI dashboards and reports for business stakeholders.
* Design and implement data integration and transformation using Azure Data Factory, Logic Apps, and Azure Functions.
* Use Python and SQL for data wrangling, transformation, and large-scale data analysis.
* Leverage OpenAI APIs to build AI/ML-driven solutions for natural language processing, data enrichment, automation, and post-sales call auditing.
* Collaborate with product managers, analysts, and data scientists to align data strategy with business objectives.
* Monitor and optimise pipeline performance, ensuring data quality, reliability, and consistency.
* Implement best practices for data governance, security, and compliance.
Required Experience & Skills
* Proven experience as a Data Engineer or Data Architect
* Proven experience designing and maintaining ETL/ELT pipelines in complex data environments
* Strong Python skills for scripting, automation, and data processing
* Advanced SQL skills across relational and cloud-based data platforms
* Hands-on experience with Azure services, including: Data Factory, Logic Apps, Azure Functions, Azure Synapse and/or Azure Data Lake
* Strong experience with Power BI, including data modelling and dashboard development
* Experience working with OpenAI APIs or similar AI/ML services
* Solid understanding of data warehousing architectures and best practices
* Excellent analytical, problem-solving, and communication skills
Nice to Have
* Experience with DevOps and CI/CD pipelines.
* Familiarity with cloud-native data platforms such as Databricks or Microsoft Fabric.
* Understanding of data privacy regulations (e.g. GDPR) and secure data handling practices.
If you’re looking for a Data Engineering position that will allow you to take ownership with the opportunity for further long term growth then APPLY NOW!