Solid Understanding of Data Engineering Concepts and experience of Building and maintaining reliable and scalable big data platform.
Experience of Integrating Azure hosted platforms within Enterprise capabilities including ServiceNow, CyberArc, Azure DevOps in an Enterprise Environment.
Experience of Implementing Development lifecycle Including dependency management and DevOps and CI/CD and tools and techniques (Azure DevOps, GIT)
Solid understanding of Cloud Services Especially MS Azure is recommended as Microsoft Fabric is integrated within Azure services.
Experience of designing robust, secure and compliant capabilities.
Strong understanding of Apache Spark, Including its Architecture, Components, and how to create, Monitor, Optimize, and Scale Spark Jobs.
Experienced working in a DevOps / Agile Team
Experience of managing environments using IAC ( terraform, APIs)
This role is based out of Edinburgh. We expect you to visit the customer site twice in a week.