The Role
The Interconnectors Data Platform (ICDP) is a cloud-based data warehouse enabling critical commercial, financial modelling, and operational decision-making. As the platform moves toward a modernized Medallion Architecture and Azure-native ingestion patterns, we are hiring a Senior Data Engineer to provide architectural direction and hands-on technical leadership.
Your responsibilities: (Up to 10, Avoid repetition
)Data Architecture & Platform Engineerin
g- Lead the design and implementation of scalable data architectures, including Bronze/Silver/Gold layered models
.- Drive the platform’s architectural roadmap and ensure alignment with modern engineering best practices
.- Develop robust, secure, and observable ingestion and transformation pipelines
.Pipeline Development & Operation
s- Lead the migration from legacy ETL tools (e.g., Matillion) into modern Azure-based pipelines, including Azure Functions, Azure Data Factory (ADF), and event-driven frameworks
.- Build and maintain performant SQL-based transformations, curated layers, and reusable data models
.- Ensure CI/CD, testing, version control, and observability are fully embedded in workflows
.Data Quality & Governanc
e- Implement data validation, reconciliation, profiling, and auditability across platform layers
.- Work with business stakeholders to ensure output meets analytical and operational needs
.Leadershi
p- Mentor data engineers and contribute to the growth of technical capability within the ICDP team
.- Collaborate with Product teams, IT&D, and external partners to deliver high-quality outcomes
.- Serve as a technical authority for engineering approaches, patterns, and standards
.
Your Profi
leEssential skills/knowledge/experience: (Up to 10, Avoid repetitio
n)Essential Technical Skil
ls- Python: Strong, hands-on experience building production-grade data pipelines, transformations, and orchestration using Pytho
n.- Advanced SQL: Expert-level analytical SQL, query optimization, and data modellin
g.- Azure Cloud: Experience with Azure Functions, Azure Data Factory, Azure Storage, Key Vault, and cloud security fundamental
s.- Data Warehousing: Deep understanding of data architecture principles, dimensional modelling, and scalable enterprise data desig
n.- Strong grounding in Git, CI/CD, automated testing, branching strategies, and modern engineering practice
s.- Experience with API ingestion, SFTP ingestion, and resilient pipeline desig
n.
Soft Ski
lls- Strong problem-solving and architectural thinki
ng.- Excellent communication and stakeholder collaboration skil
ls.- Ability to provide clarity and leadership in complex or ambiguous technical landscap
es.Desirable skills/knowledge/experience: (As applicab
le)Experience contributing to or leading data-platform re-architecture progra
ms.- Exposure to Medallion/Lakehouse patterns or Databricks-style ecosyste
ms.- Experience in regulated or high-assurance data environmen
ts.- Collaboration with modelling teams or environments where engineering and modelling interse
ct.