Senior Data Engineer – Query Federation & Data Lakehouse
Location - London
Salary - £70,000
Hybrid - 2 days per week central London
The Role
I am working with a leading technology services organisation to find an experienced Senior Data Engineer to join their AI & Data team. You'll take ownership of enterprise data infrastructure, ensuring clients can seamlessly access and utilise their data across multiple platforms.
What You'll Be Doing
* Deploying, configuring and managing Trino/Starburst Enterprise and Galaxy environments, including upgrades and performance tuning
* Administering a Dell Data Lakehouse platform, setup, maintenance, and ensuring high availability
* Integrating diverse data sources into a unified, accessible data platform
* Designing and tuning containerised solutions (Kubernetes/OpenShift) for scalability and resilience
* Setting up and managing data catalogs across multiple operational modes
* Implementing security controls, managing data access governance, and ensuring regulatory compliance
* A degree in Computer Science, Data Science, Engineering or a related field or equivalent practical experience
Skills to have:
* Proven Trino/Starburst Enterprise/Galaxy administration experience
* Strong Unix/Linux skills and solid understanding of distributed systems
* Kubernetes or OpenShift container orchestration experience
* Familiarity with Big Data (Hadoop/Hive/Spark) and cloud platforms (AWS, Azure, GCP)
* Knowledge of security frameworks: LDAP, Active Directory, OAuth2, Kerberos
Nice to Have:
* Starburst Certified Practitioner certification
* Python and/or Java experience
* Ansible or similar automation tooling
* Dell Data Lakehouse administration experience
Occasional out-of-hours availability may be required for project go-lives.