Role Description
This is a full-time hybrid role for a Data Engineer, based in the London/Edinburgh area, United Kingdom, with the flexibility to work remotely part of the time. The Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and workflows. This includes developing, testing, and optimizing Extract, Transform, Load (ETL) processes, ensuring the integrity and availability of data warehouses, and collaborating with analytics teams to deliver actionable insights from data.
* Qualifications
* Proficient knowledge of SQL
* Experience in interrogating data and root cause analysis/ problem solving.
* Experience in understanding business requirements and translating them into technical requirements.
* Good written and oral communication with stakeholders at all levels. internal as well as extemal.
* Minimum 5 vears working as a Data Engineer.
* Experience designing, building, and maintaining scalable data pipelines and ETL processes.
* Proficiency with data processing frameworks and tools, primarily Apache Airflow, Apache Falcon.
* Strong understanding of data warehousing concepts and experience with cloud-based data platforms primarily AWS
* Knowledge of data modelling, scherna design, and optimisation techniques for large datasets.
* Familiarity with scripting/programming languages such as Python for data manipulation and automation.
* Understanding of data governance, quality, and security best practices.
* Experience with containerisation and orchestration tools (e.g., Docker, Kubemetes) is a plus.
* Ability to troubleshoot data pipeline issues and optimise data workflows for performance and scalability.