Data Engineer
London | Hybrid | Full-time
Are you a skilled Data Engineer eager to work with high-volume datasets and cutting-edge technologies? We’re looking for a data-driven professional to develop and optimise a scalable data platform that supports advanced analytics and quantitative research. You’ll play a key role in designing robust data pipelines, integrating real-time feeds, and ensuring the seamless flow of structured and unstructured data.
In this role, you'll be responsible for building and maintaining high-performance data pipelines that process complex and large-scale datasets. You'll work closely with analysts and researchers to understand their data requirements, optimising real-time data ingestion by integrating external APIs and alternative data sources. You will focus on enhancing the data architecture to improve accessibility, efficiency, and security while automating ETL workflows to streamline data modelling and analysis. You’ll also support event-driven systems by implementing technologies like Kafka and Protobuf, ensuring seamless data streaming and processing. A key aspect of your role will be implementing rigorous quality assurance measures, ensuring data integrity and consistency across all inputs and outputs. Additionally, you'll collaborate with teams to support machine learning applications, facilitating data preparation for model training and deployment.
What You’ll Need
3+ years of experience in a data engineering
Strong proficiency in Python and Rust
Hands-on experience with AWS cloud, Linux, and Docker.
Expertise in distributed computing frameworks (Ray, Dask, or Apache Arrow).
Strong analytical skills, with the ability to handle large-scale, high-frequency data
.Solid understanding of ETL pipelines, data modelling, and database optimisation.
Experience working with real-time streaming technologies
This is a fantastic opportunity to be part of a fast-moving, data-driven environment where your technical expertise will have a real impact. You'll work with cutting-edge tools, collaborate with top-tier professionals, and contribute to the efficiency and innovation of a growing data team.