Senior Data Engineer (active SC clearance required) Location : UK (Remote, occasional London travel) | Permanent: £60-85K Role Overview Hands-on Data Engineer working with public sector clients to design, build, and operate production data platforms. Lead technical architecture across cloud environments, mentor delivery teams, and embed analytics/AI capabilities in agile, client-facing projects. Key Responsibilities p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Translate complex business challenges into scalable data pipelines, models, and analytics solutions p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Build/operate production-grade pipelines using SQL/Python/Spark across lakehouses and event-driven systems p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Architect semantic models and data visualisations for business intelligence platforms p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Deploy cloud data/AI solutions (AWS/Azure) with robust CI/CD, testing, and security practices p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Integrate ML models, experimentation frameworks, and governance workflows p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Deliver client-ready dashboards, insight narratives, and consulting materials p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Collaborate across multidisciplinary teams in agile, iterative delivery cycles Technical Environment Core : Advanced SQL/Python, PySpark/Pandas, Spark orchestration tools Cloud : AWS (Databricks/Redshift equivalents), Azure analytics platforms, Git/CI-CD Architecture : Data lakehouses, event streaming, semantic modelling for BI tools AI/ML : Model APIs, prompt engineering, experimentation frameworks Governance : Data catalogues, lineage tracking, security/access controls, GDPR Essential Requirements p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Expert SQL/Python for data modelling, transformation, and automation p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Production data engineering: Spark/PySpark, cloud platforms (AWS or Azure) p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Data architecture experience: lakehouses, event-driven systems, BI semantic models p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Software engineering: Git workflows, CI/CD pipelines, testing frameworks p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Analytics: experimentation design, statistical analysis, insight storytelling p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Consulting mindset: stakeholder collaboration, client deliverables, agile delivery p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> ACTIVE SC clearance required Desirable p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Public sector/government project delivery p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Advanced BI semantic modelling (Power BI/Tableau equivalents) p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Operational intelligence platforms or data mesh implementations p]:pt-0 [&>p]:mb-2 [&>p]:my-0'> Data governance frameworks (lineage/catalogues/access management)