Data Engineer (Python/AWS)
Belfast - 3 Days Onsite - 2 Days Remote
12 Month Initial Contract
Inside IR35
We are seeking an experienced Data Engineer to join our client on a long-term assignment in Belfast. This role requires a skilled engineer with strong Python and AWS expertise who can build, optimise, and maintain high-quality data pipelines in a complex environment.
Key Responsibilities
* Design, develop, and maintain robust data pipelines and ETL processes.
* Build and optimise data workflows using Python.
* Manage workflow orchestration with Apache Airflow (MWAA).
* Perform data testing, validation, and produce data quality reports.
* Conduct data exploration and analysis to understand data structures prior to ETL development.
* Collaborate with system owners and stakeholders to gather requirements and deliver solutions.
* Monitor, troubleshoot, and ensure reliability and performance of data pipelines.
* Maintain clear documentation of data workflows, processes, and configurations.
Experience & Competencies
* 4+ years’ experience as a Data Engineer.
* Strong SQL/PLSQL skills across MS SQL and Oracle.
* Extensive hands-on experience coding in Python.
* Solid understanding of ETL concepts and data pipeline architecture.
* Knowledge of data lakes and associated architectures.
* Experience with Apache Airflow (MWAA).
* Familiarity with AWS Athena / PySpark (Glue).
If you would like immediate consideration, please send me an updated CV/contact details to jcaria@redglobal.com so we can discuss further or reach out to me through LinkedIn.