Job Title: Data Engineer
Location: London (Hybrid one day a week)
Job Summary:
Signify have partnered with a client who are seeking for a Senior Data Engineer to join their growing data team. This role involves designing, building, and maintaining data pipelines and infrastructure to support analytics and business intelligence efforts across the organisation. The ideal candidate will have a strong background in handling large-scale data environments and a passion for creating scalable, efficient data solutions.
Key Responsibilities:
* Manage and maintain day to day data operations, including ETL workflows, scheduled data loads, and data pipeline monitoring.
* Develop and optimise data pipelines for integrating structured and unstructured data from various internal and external sources.
* Leverage big data technologies such as Apache Spark, Kafka, and Scala to build robust and scalable data processing systems.
* Write clean, maintainable code in Python or Scala to support data transformation, orchestration, and integration tasks.
* Work with cloud platforms like AWS to deploy, monitor, and manage data services.
* Utilise tools such as DBT and Snowflake for data modeling, transformation, and warehouse management.
* Collaborate with analysts, data scientists, and business stakeholders to ensure data accuracy, consistency, and availability.
* Apply strong analytical thinking and problem-solving capabilities to troubleshoot data issues and optimise system performance.
Qualifications:
* Proficient in handling multiple data sources and integrating data across different systems.
* +4 years experience as a Data engineer
* Hands-on expertise in Spark, Kafka, and other distributed data processing frameworks.
* Solid programming skills in Python
* Strong familiarity with cloud data ecosystems, especially AWS.
* Strong knowledge of DBT and Snowflake
* Strong problem-solving mindset with the ability to diagnose and resolve technical challenges.
* Excellent communication skills and the ability to work effectively in a cross-functional team.