Job Title: Lead Data Engineer
Duration: long-term contract
Location: UK Based Hybrid (x2-3 days from Birmingham)
Visa: No sponsorship available/ No PSW
Overview:
We’re looking for a hands-on Lead Data Engineer to design, build, and optimize scalable data pipelines and infrastructure for global banking projects. You’ll lead a team, drive engineering best practices, and ensure data reliability, security, and compliance.
Key Responsibilities:
* Lead and mentor a team of data engineers, establishing best practices in data engineering.
* Design, build, and maintain scalable, secure, and reliable data pipelines and architectures.
* Develop and optimize ETL processes, integrating diverse data sources into unified platforms.
* Ensure data quality, governance, and compliance with regulatory requirements.
* Collaborate with data scientists, analysts, and IT teams to support analytical and business goals.
* Monitor, troubleshoot, and enhance data performance and infrastructure.
Key Skills & Experience:
* Strong experience with SQL/NoSQL databases, data warehousing, and big data (Hadoop, Spark).
* Proficient in Python, Java, or Scala with solid OOP and design pattern understanding.
* Expertise in ETL tools, DevOps and orchestration frameworks (Airflow, Apache NiFi).
* Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data services.