Data Engineer, Permanent, up to £80k, London
My client, an energy leader at the forefront of the UK market, is searching for a Data Engineer to join them as soon as possible. This is an exciting opportunity to join a highly experienced data and trading team helping to shape the future of energy through data-driven insight and technology.
We are looking for a Data Engineer who's passionate about building scalable, high-performance data systems using open-source technologies. You'll play a key role in developing robust pipelines, optimising performance, and supporting real-time analytics across the business.
What You'll Do
* Design and build robust data ingestion pipelines using modern open-source frameworks
* Develop and optimise ETL/ELT processes for large-scale data sets
* Create data models that power analytics and business insights
* Work closely with analysts and product teams to translate business needs into data solutions
* Implement data validation and quality checks to ensure data reliability
What You'll Bring
* Strong SQL and Python skills (pandas, NumPy, Spark)
* Hands-on experience with Apache Spark, Kafka, and Airflow
* Solid understanding of data warehousing and distributed computing
* Experience with Docker, Kubernetes, and CI/CD pipelines
* A problem-solving mindset and the ability to communicate complex ideas clearly
Please apply for more information
#J-18808-Ljbffr