Position Description:
At CGI, we help organisations harness the power of data to improve services, drive efficiency, and deliver meaningful outcomes. As a Data Engineer, you’ll contribute to a modern, large-scale data platform, building reliable and scalable pipelines that enable trusted insight and better decision-making. Working within a collaborative delivery environment, you’ll apply strong engineering practices, take ownership of your solutions, and continuously improve how data is designed, processed, and consumed. You’ll be supported to develop your skills, share ideas, and grow your career while delivering work that makes a real difference.
CGI was recognised in the Sunday Times Best Places to Work List and has been named a UK ‘Best Employer’ by the Financial Times. We offer a competitive salary, excellent pension, private healthcare, plus a share scheme (3.5% + 3.5% matching) which makes you a CGI Partner not just an employee. We are committed to inclusivity, building a genuinely diverse community of tech talent and inspiring everyone to pursue careers in our sector, including our Armed Forces, and are proud to hold a Gold Award in recognition of our support of the Armed Forces Corporate Covenant. Join us and you’ll be part of an open, friendly community of experts. We’ll train and support you in taking your career wherever you want it to go.
Due to the secure nature of the programme, you will need to hold UK Security Clearance or be eligible to go through this clearance. This is a hybrid position, with an on-site presence in Swansea two days per week.
Your future duties and responsibilities:
In this role, you will design, build, and maintain robust data pipelines using Databricks, supporting a large-scale data platform. You’ll work closely with data engineers, analysts, and architects to ensure solutions align with agreed data models, architectural standards, and best practices. Your work will help ensure data is reliable, well-governed, and fit for purpose.
You’ll take responsibility for pipeline performance and data quality, contribute to continuous improvement, and support a collaborative team culture where learning and improvement are actively encouraged.
Key responsibilities include:
• Build & Deliver: Develop and maintain Databricks pipelines, including Delta Live Tables, using PySpark and Python.
• Ensure Quality: Maintain data quality, consistency, and lineage across all data sources and destinations.
• Orchestrate & Monitor: Implement orchestration, scheduling, and monitoring to ensure reliable data operations.
• Collaborate & Align: Work with data team members to ensure alignment with target architecture and best practices.
• Troubleshoot & Improve: Identify and resolve data issues across development and production environments.
• Document & Share: Maintain clear technical documentation for pipelines, jobs, and integrations.
Required qualifications to be successful in this role:
To be successful, you will have hands-on data engineering experience, a strong technical foundation, and the ability to work collaboratively in structured delivery environments. You should be comfortable owning your work while contributing positively to team outcomes.
Essential qualifications:
• Experience using Databricks, including Delta Live Tables (DLTs).
• Strong skills in SQL, Python, and PySpark.
• Experience working with SSIS packages.
• Proven experience building and maintaining data pipelines.
• Good understanding of data quality, consistency, and lineage.
Desirable experience:
• Exposure to AWS or Azure cloud platforms.
• Strong data modelling and data transformation experience.
• Knowledge of CI/CD, version control, and DevOps practices for data.
• Experience with data quality, testing, and observability tooling.
• Familiarity with JIRA and Confluence.
#LI-JW1
Skills:
1. Python
2. SQL
3. SQL Server