Data Engineer – AzureA fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment.Based in either Derby or London, the successful candidate will be joining a dynamic team that supports corporate and project governance, risk management, and audits across various stakeholders. As part of the Operations Directorate and reporting to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward.Key ResponsibilitiesAs a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented team, the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary.What you’ll be getting up to:Monitoring and recovery of Azure Data Factory and Databricks jobsProactive monitoring of data qualityBecoming a subject matter expert on the company's data sources and ingestion methods.Assisting in developing and adhering to data governance policies and internal processesCollaborating with the wider team to understand business needs and improve data quality.Developing and maintaining data quality KPIsMaintaining and monitoring user-facing dashboards and internal digital productsUpdating and patching existing digital software productsDocumenting root cause analysis outputsWhat you can bring to the roleMicrosoft Azure experienceProficiency in Azure data components such as Azure Data Factory, Azure SQL DB, Azure Data Lake, etc.Strong Python and SQL skills for data manipulationExperience with Apache Spark and/or Databricks.Familiarity with BI visualization tools like Power BIExperience in managing end-to-end analytics pipelines (batch and streaming)Proficiency in root cause analysis and post-incident reporting in a production environmentExcellent interpersonal skillsStrong report writing, presentation, and record-keeping abilities.Exceptional communication and stakeholder management skillsKnowledge and QualificationsRelevant degree in Computer Science, Engineering, or related fieldCertifications such as Azure Data Engineer Associate are desirable.Knowledge of data ingestion methods for real-time and batch processingProficiency in PySpark and debugging Apache Spark workloads.What’s in it for you? Annual bonus scheme – up to 10%Excellent pension schemeFlexible workingEnhanced family friendly policiesOngoing support with professional and personal developmentAdoption & Shared Parental Leave benefitsEnhanced Armed Forces policies.Long service awardsCompany Star awardsLife assuranceHealthcare cash plan25 days’ annual leave + Bank Holidays + option to buy and sell up to 5 days’ additional leave.Additional days annual leave for long serviceSeason ticket loan.Cycle to work scheme.Free parkingShould you be suitable for the role, the full benefits package will be discussed in more detail during your screening call.Mirai believes in the power of diversity and the importance of an inclusive culture. We welcome applications from individuals of all backgrounds, understanding that a range of perspectives strengthens both our team and our partners' teams. This is just one of the ways that we’re taking positive action to shaping a collaborative and diverse future in the workplace.