12m FTC
The Team:
The Data Engineering team is positioned in the Delivery business unit of the IT function within the Data & Automation department sitting alongside the Report Engineering, Data Governance, Data Migrations and Automation teams.
Data Engineering is a perfect blend of Data Engineers and QA Engineers that are renowned for their forward thinking and trail blazing. Exceptionally talented, supportive and personable, it’s an area that’s challenging, provides excellent growth opportunities and rewarding.
Role Expectations:
* Design, build, and maintain Azure infrastructure with Terraform (IaC) as the single source of truth.
* Develop and optimise CI/CD pipelines in Azure DevOps to automate deployment of workspaces, Unity Catalog, networking, and security.
* Work with Databricks (Spark/Scala, PySpark) to support ingestion frameworks, data processing, and platform-level libraries.
* Implement secure connectivity (VNET injection, Private Link, firewall, DNS, RBAC).
* Monitor, troubleshoot, and optimise platform reliability and performance.
* Partner with architects, engineers, and product teams to enforce best practices in governance, security, and automation.
* Document infrastructure, processes, and standards for wider engineering adoption.
Must Have:
* Proven expertise with Microsoft Azure (networking, security, storage, compute).
* Strong proficiency in Databricks with hands-on Scala (Spark) and PySpark.
* Deep experience with Terraform for Azure resource deployment and governance.
* Hands-on with Azure DevOps pipelines (YAML, agents, service connections).
* Understanding of Azure Active Directory / Entra ID, RBAC, and service principals.
* Familiarity with monitoring and logging in Azure (Log Analytics, Monitor, Application Insights).
* Excellent problem-solving and collaboration skills.
* Experience in large-scale enterprise environments and agile delivery.