Lead Data Engineer
London (2 days per week)
£100,000 - £130,000 + equity
About the role
I’m working with a scaling Techbio company that’s built its entire data platform on GCP and is now hiring a Lead Data Engineer to take real ownership of it.
They handle genuinely sensitive, population-scale health data for pharma and biotech customers, with multi-terabyte datasets landing regularly from third parties and from Azure environments that need to be pulled safely into BigQuery.
They’re looking for someone who can come in and make sense of that environment quickly… design ingestion patterns for huge data drops, think carefully about cost and observability, and work closely with internal medical teams to translate real-world questions into production systems.
Big egos will not fit in here, they're a super smart, super humble team and the right person will be given freedom to take real ownership with the opportunity to work on cutting-edge AI, custom build LLMs, infrastructure - whatever suits you best!
Requirements:
* Has deep, hands-on experience running data platforms on GCP
* Uses Python day-to-day
* Has operated BigQuery at scale, and understands how queries behave across hundreds of terabytes
* Has built production systems with Airflow / Composer, DBT, Terraform and Docker
* Is comfortable with GKE, Cloud Run or Cloud Functions
* Has worked with streaming systems built on Dataflow / Apache Beam
* Has experience working in regulated environments and alongside security teams, ideally with exposure to ISO27001
* Can work closely with non-technical stakeholders and shape solutions rather than just execute tickets
*Visa sponsorship is not available, so please only apply if you have full UK working rights*