Job Profile
Our client are going through a large, global digital transformation that is focused around an ERP standardisation to Dynamics 365. This role will underpin that transformation by leading on all design, development and implementation of data solutions within the organisation. This is critical for the business to utilise it's aggressive implementation of Dynamics 365, all its modules and workflow processes, through to the the implementation of advanced analytics including self-service analytics.
Responsibilities
* Design and implement scalable, resilient ETL/ELT pipelines for batch and real-time data across databases, APIs, streams, and file systems
* Build and optimise lakehouse and data warehouse architectures for structured and semi-structured data
* Collaborate with engineering and integration teams to deliver fit-for-purpose batch and real-time data solutions
* Establish frameworks for data quality, observability, and schema evolution to ensure reliable, traceable pipelines
* Drive performance and cost optimisation through effective resource management, partitioning, indexing, caching, and monitoring
* Ensure data architecture aligns with governance, security, privacy, and operational standards (including DR and auditability)
* Partner with technical and business stakeholders to design and deliver AI-driven capabilities
Skills
* Data Architecture - need to have led on the design and implementation of multiple data architectures.
* Data Integrations - batch and real time integrations, working on a design that allows these alongside the engineers within the data and further development teams
* Data Warehouse and Lakehouse improvements - ideally someone who has built from scratch so understands the in's and out's and that can continue to develop best practice and deliver improvements
* Modern Data Engineering - Microsoft Azure, Synapse, Fabric are a must
* DevOps mindset
Desirable
* Experience of integration data governance tools - Purview - into data architecture.