We\'re looking for a Senior Data Engineer to join our Consumption Domain — the team responsible for how data is exposed and delivered across our intelligence platform.
You\'ll own data pipelines end-to-end: from ingestion and transformation through to API design and delivery. You\'ll work on complex, relationship-driven datasets at scale, solving real technical challenges around data quality, performance, and reliable access to critical information.
This is not a pure infrastructure or ETL specialist role. You\'ll own the full journey: raw data → clean data → transformed insights → exposed APIs. You\'ll think about how data is consumed, what reliability means, and how systems fail.
What You'll Work On
* Designing and optimising APIs that serve complex, relationship-driven datasets
* Building scalable ETL/ELT pipelines and data ingestion systems
* Managing evolving schemas, data models, and quality assurance across structured and unstructured sources
* Improving performance and reliability of data systems at scale
* Ensuring observability, monitoring, and data validation throughout the platform
* Collaborating with architects, platform teams, and downstream consumers on complex data challenges
The platform processes large-scale intelligence data with complex relationships. Your systems will directly impact how thousands of users access critical information. You\'ll work on event-driven data flows, distributed systems, and the technical challenges that come with knowledge graphs and complex data structures.
What We're Looking For
* End-to-End Ownership Mentality: You\'ve owned data pipelines from raw ingestion through to final consumption (API, dashboard, or service). You understand the impact of your decisions on downstream users and you\'ve had to ensure quality throughout.
* Complex Data Systems Experience: You\'ve worked with complex, relationship-driven datasets at scale. You understand data modelling, entity relationships, and how to structure data for multiple consumption patterns.
* API Design & Data Exposure: You\'ve built APIs or data endpoints that expose information to consumers. You think about how data is consumed and what makes an interface useful. (If you\'ve never built an API, you\'ll likely struggle in our environment.)
* Data Quality & Observability Focus: You\'ve ensured the quality of systems you\'ve built. You understand data validation, schema evolution, monitoring, and how to know when something breaks. Quality isn\'t an afterthought.
* Distributed Systems Thinking: You\'ve worked with systems at scale where reliability, performance, and eventual consistency matter. You understand trade-offs between correctness and speed, single-node vs. distributed behaviour.
Nice to Have
* Neo4j, graph databases, or graph data experience (we work with knowledge graphs)
* Event-driven architecture or streaming systems (Kafka, Kinesis, or similar)
* Modern data stack tools (Spark, Databricks, Snowflake, data lakehouses)
* Experience with complex data transformations or inference logic
* AWS
* Infrastructure as Code, CI/CD pipelines, observability tools
Why This Matters
This organisation sits at the intersection of data, intelligence, and critical infrastructure. The platform serves governments, defence organisations, and commercial enterprises with structured, verified intelligence. The systems you build directly impact how decision-makers access critical information.
This isn\'t a routine data engineering role. You\'ll solve genuine technical challenges: optimising query performance across millions of records, handling evolving data schemas, building systems that balance accuracy with speed, and designing APIs that serve complex downstream needs.
What We Offer
* 15% discretionary bonus
* 27 days annual leave
* BUPA private medical
* Parental leave (100% for 26 weeks maternity, 6 weeks paternity)
* Hybrid working: 2 days per week in our Manchester office
* Technically-focused team environment
* Close collaboration with architects, infrastructure teams, and product stakeholders
* Opportunity to shape data platform direction and engineering standards
About You
You\'re someone who enjoys solving complex technical problems end-to-end. You take ownership of data from raw source through to final delivery. You think about reliability, performance, and how systems fail. You\'re comfortable saying "that won\'t work because..." and proposing alternatives.
You\'re based in or willing to commute to Manchester. Right to work in the UK is required (we\'re unable to sponsor visas at this time).
How to Apply
If this sounds like you, reach out with:
* Your CV
* A brief note on what interests you about this role
* Your availability for a call
We\'ll move quickly through the process — we\'re looking to hire in the coming weeks.
#J-18808-Ljbffr