Overview
Join to apply for the Senior Data Engineer ( SC Cleared/ SC Eligible ) role at Scrumconnect Consulting.
About Scrumconnect: Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has delivered more than 64 services in the past two years, reaching over 50 million citizens and achieving savings for the taxpayer of over £25 million.
Role Overview
We are seeking an experienced Senior Data Engineer to develop, maintain, and optimise data products and a Strategic Data Platform. You will be part of multi-functional Agile delivery teams, ensuring operational stability, ongoing support, and enhancement of scalable data solutions. The role requires strong technical expertise in Azure data tools, SQL, Python, and modern engineering practices, with a focus on migration, data governance, and advanced analytics capabilities.
Key Responsibilities
* Design, build, and maintain data solutions using Azure Data Factory and Azure Synapse.
* Manage the end-to-end data development lifecycle within Agile delivery teams.
* Integrate and automate workflows into Azure DevOps pipelines.
* Create and maintain dimension data models and semantic models for Power BI integration.
* Develop advanced dashboards, visualisations, and reporting solutions using Power BI.
* Implement data governance, quality checks, and profiling to ensure accuracy and compliance.
* Lead the migration of legacy data capabilities to modern Azure-based platforms.
* Apply dbt with SQL databases for data transformation, modelling, and workflow optimisation.
* Collaborate with stakeholders to translate business requirements into robust technical solutions.
* Coach and mentor team members, fostering best practices in data engineering.
Essential Skills & Experience
* Active SC Clearance (mandatory at application stage).
* Proven expertise in:
* Azure Data Factory & Azure Synapse
* Azure DevOps & Microsoft Azure ecosystem
* Power BI (including semantic models)
* Python (incl. PySpark) and advanced SQL
* dbt with SQL DBs (data transformation & modelling)
* Dimension data modelling
* Terraform for infrastructure-as-code deployments
* Strong experience with both structured and unstructured data.
* Delivery track record in Agile environments.
* Business analysis skills to capture and translate service needs into technical solutions.
* Proven success in legacy migration projects within complex organisations.
* Excellent communication and collaboration skills across technical and non-technical teams.
Desirable
* Azure certifications (Data Engineer, Data Scientist, or related).
* Knowledge of GDPR compliance, data security, and governance best practices.
Seniority level
* Mid-Senior level
Employment type
* Full-time
Job function
* Information Technology
* Industries
* Software Development
#J-18808-Ljbffr