Role Summary
Aubay is seeking an experienced Senior Data Engineer with great interpersonal skills to join our team. Our business has been built on a foundation of innovative technology and skilled people. By providing energy to sustain people's lives over many years, we have become one of the world's leading companies. Our IT Engineering team offers you the chance to make an impact that matters – be it in complex predictive maintenance and inventory management solutions to optimize the uptime of our assets or innovative solutions that satisfy customers worldwide.
Your growth is our future in IT Engineering. Information technology supports all aspects of our businesses, and we have some of the world's most complex problems to solve. You will not only get an opportunity to work with the latest technology, but with our scale, you will also get the chance to shape future digital technology by working with industry leaders. With open-source technology being important to us, you will also have the opportunity to contribute back to the software community. The diversity of positions on offer will help you grow in your career.
The Senior Data Engineer will play a critical role in designing, building, and maintaining scalable data pipelines and analytics solutions using Azure and Data bricks ecosystem. Collaborate closely with business stakeholders - to ensure data is accessible, reliable, and optimized for performance.
Key Accountabilities:
* Design and implement robust data pipelines using Azure Data Factory (ADF) and Databricks.
* Develop scalable ETL/ELT processes to ingest, transform, and load data from various sources.
* Write clean, efficient, and reusable Python code for data processing and automation.
* Optimize and manage SQL queries for data extraction, transformation, and reporting.
* Collaborate with business stakeholders to understand data requirements and deliver solutions aligned with business goals.
* Ensure data quality, integrity, and security across all data platforms.
* Monitor and troubleshoot data pipelines to ensure high availability and performance.
* Implement logging, alerting, and error-handling mechanisms for proactive issue resolution
* Apply domain knowledge of trading and financial markets to enhance data models and analytics capabilities.
Required Skills and Experience
* 5+ years of experience in data engineering or related roles.
* Proven expertise in
Azure Data Factory
and
Azure Databricks
.
* Strong proficiency in
Python
for data engineering tasks.
* Solid understanding of
SQL
and relational databases.
* Exposure to real-time data processing frameworks (e.g., Spark Streaming, Kafka).
* Experience in maintaining and supporting production-grade data pipelines.
* Familiarity with
trading business domain
, including market data, trade lifecycle, and financial instruments.
* Experience with version control systems (e.g., Git) and CI/CD pipelines.
* Excellent problem-solving skills and attention to detail.
* Strong communication and collaboration abilities
About Aubay UK
– Ahead of Innovation
Aubay UK is a recognised InSourcing Partner for client-side deployment delivered across London and the GCC. Our team, based in Canary Wharf, specialises in hiring IT professionals within the Energy and FinTech sectors, helping our clients to expand their operations with top-tier talent who are experts in their fields. We work exclusively with clients who are globally recognized as Energy Super Majors/Financial Services and innovative FinTech players.
Aubay UK is the most recently started branch of Aubay Group
.
Aubay Group are an international Digital Services Company, listed on a Euronext Stock Exchange, who have been operating for 21 years in the European market and working alongside some of the biggest names in the Banking, Finance, Insurance, Energy, IT/Digital, Manufacturing, Transport and Telecoms sectors. With over 7,000 employees across 7 countries and 16 offices in England, France, Belgium, Luxembourg, Italy, Spain, and Portugal, Aubay Group generated revenues of €435 million in 2019.
What Aubay UK Offers
At Aubay UK, people are at the heart of our business. We offer a competitive renumeration package which includes a range of benefits. You will receive continuous support from our dedicated team of Talent Acquisition Specialists who will support your career development and success during your assignment with our client. Other benefits include:
* Annual Leave + Bank Holidays
* Work from home opportunities
* Access to Udemy training platform and conferences
* Perkbox employee discount scheme
* Discount on winter sports holiday at
* Opportunity to work directly for the client at the end of assignment
Our Client
Our client is a leading global energy company and the state-owned petroleum corporation, with operations spanning over 30
countries. With a commitment to energy sustainability and economic growth, our client specializes in Exploration & Production, Natural Gas, Liquefied Natural Gas (LNG), Petrochemicals, Refining, and Renewables. The company plays a vital role in the global energy sector, leveraging the
GCC country's position
as one of the world's top natural gas producers. As part of the team, you'll be part of a dynamic and innovative environment, contributing to ambitious goals to meet rising global energy demands through sustainable energy solutions. In your role, you will help drive impactful projects worldwide, supporting the company's vision to diversify and ensure reliable, low-emission energy while delivering value and operational excellence.
Apply via our website -
You will be working remotely initially. Aubay UK is proud to be an equal opportunity employer. All aspects of employment decisions will be based on merit, competence, performance, and business needs
.