About the role
As a Senior Data Engineer at Informed Solutions, you will design, build, and deliver robust data platforms and pipelines that underpin critical public sector services. Your work will enable better decision‑making, improve service outcomes, and help create a healthier, safer, and more sustainable UK.
Role Responsibilities
* Own delivery of data services: take responsibility for the engineering and delivery of small‑to‑medium data services across the full lifecycle, from design and build through to deployment, operation, and continual improvement.
* Lead on data architecture and design: own the end‑to‑end design of data pipelines, data models, and platform components; collaborate with lead and principal engineers, data architects, and other practitioners to review and refine designs.
* Build and operate data pipelines: design, develop, test, and deploy ETL pipelines to source, cleanse, and optimise data at scale.
* Automate and orchestrate data workflows: develop and maintain orchestration solutions such as Apache Airflow, implementing testing, alerting, monitoring, and data quality checks.
* Ensure data quality and observability: embed data testing and validation processes alongside monitoring and alerting systems such as Prometheus and Grafana.
* Work with metadata and standards: implement metadata capture and validation within data pipelines, including geospatial metadata standards where relevant.
* Support delivery planning: partner with delivery managers to plan and structure technical activities, provide accurate estimates, and proactively identify and mitigate technical risks, issues, and dependencies.
* Build stakeholder trust: act as a trusted technical advisor to client counterparts, partner organisations, and third parties, ensuring alignment between data requirements, business needs, and technical delivery.
* Mentor and develop others: provide guidance and technical leadership to data engineers and adjacent roles, supporting professional growth and fostering a culture of high‑quality, sustainable delivery.
Requirements
Essential Skills
* 5+ years proven experience in a data engineering role, delivering production‑grade data platforms and pipelines.
* Strong Python skills, with experience building, testing, and operating data pipelines and services.
* Proficiency with at least one major cloud platform (AWS, Azure, or GCP) delivering scalable, secure, and well‑architected data solutions.
* Strong experience with core data stores, including relational databases such as PostgreSQL and Microsoft SQL.
* Experience with non‑relational and NoSQL data stores (e.g., DynamoDB, MongoDB) and understanding when to apply them.
* Hands‑on experience designing and operating event streaming platforms including Kafka.
* Experience building and operating automated data workflows using tools like Apache Airflow.
* Experience implementing data quality and validation checks throughout pipelines to ensure accuracy, completeness, consistency, and reliability.
* Practical experience implementing monitoring, observability, and alerting for data platforms using tools such as Prometheus and Grafana.
* Strong understanding of data architecture patterns, including data lakes, data warehouses, and event‑driven architectures.
* Awareness of GDPR and data protection practices, including secure handling of sensitive data and privacy‑by‑design principles.
* Experience working in Agile environments (Scrum, Kanban) and contributing to delivery planning, estimation, and iterative improvement.
* Proven experience mentoring and supporting other engineers, enabling high‑quality delivery and team capability growth.
* Familiarity with metadata standards, including experience validating and implementing metadata; exposure to geospatial metadata standards (e.g., ISO 19115, INSPIRE, GEMINI) is highly desirable.
Desirable Skills
* Experience working in a consultancy environment, engaging with external stakeholders and clients.
* Exposure to public sector projects and delivering solutions in complex organisational landscapes.
* Experience working with geospatial or GIS data (spatial databases, geospatial data formats, or services) is highly desirable.
* Experience with graph databases (e.g., Neo4j, Apache Jena) for modelling and querying complex relationships in data.
Key Abilities That Are Necessary For Success
* Ability to adapt to innovative practices involving uncertainty, change, and agile working.
* Ability to manage competing priorities and time to deliver high‑quality work within deadlines.
* Good interpersonal skills, respecting and accepting different perspectives, and working collaboratively in diverse teams.
* Good judgement and decision‑making in complex environments where uncertainty, ambiguity, and risk must be collaboratively managed.
* Strong communication skills, including clear, constructive written outputs and measured, respectful verbal delivery.
What You'll Gain
* Ownership and influence: lead delivery, shape technical direction, and influence project outcomes at a senior level.
* Professional growth: develop leadership and mentoring skills, guiding colleagues and helping them thrive.
* Exposure to high‑profile projects: work on enterprise‑scale digital solutions that improve public services and have societal impact.
* Technical development: expand expertise across a wide range of modern technologies, including cloud, microservices, and serverless architectures.
* Collaborative, supportive environment: join a team that values learning, knowledge sharing, and continuous improvement.
* Career progression: opportunities to grow within a consultancy setting, broadening client‑facing experience and technical leadership.
Benefits
* InformedACADEMY™ – career development programmes and support with professional certifications.
* Industry‑leading health and wellbeing plan, including 24/7 GP services, mental health support, and physical health support.
* Hybrid working.
* Private healthcare cover.
* Generous life assurance cover.
* Gym membership.
* Monthly office lunch.
* Onsite massage sessions.
* 25 paid working days holiday per year plus bank holidays.
* Sabbatical leave scheme.
* Enhanced maternity leave and pay.
* Enhanced paternity leave and pay.
* Company pension contribution.
* Profit share scheme.
* Payment of professional subscriptions.
* Generous referral scheme with no limits on the number of referrals.
* Qualifying period applies.
#J-18808-Ljbffr