Duration: 6 months
Location: Telford with 2 days/week in office
IR35 Status: Inside
Clearance Required: SC ACTIVE
The role falls within the Data Contract Delivery Area of the client’s contract. The group provides a wide range of data and analytics solutions in support of our client’s business priorities: maximise revenues, bear down on fraud, and cloud migration.
This role involves migrating data from legacy on-premise systems (primarily Oracle and Informatica) to a new AWS cloud-native architecture.
You will be part of an Agile software delivery team working closely with other engineers and supported by project managers, business analysts, and architects, with additional client and key stakeholder interaction as required.
We are looking for strong AWS Senior Data Engineers who can design and deliver cloud transformation projects. Your work will be to:
* Support the technical lead with design and client interactions, and support junior engineers with their development.
* Design, develop, and test data pipelines to ingest, process, and transform data, ensuring it is ready for analytics and reporting.
* Implement ETL/ELT processes to seamlessly move data from source systems to data warehouses, data lakes, or lake houses using open source and AWS tools.
* Adopt DevOps practices, utilising CI/CD methodologies and tools.
Must-have Skills
* Proficiency with core AWS tools (AWS Glue, Lambda, S3, Redshift).
* Programming skills in Python.
* SQL and data storage technologies, including knowledge of data warehouses and databases (AWS Redshift, AWS RDS).
* Experience with AWS data lakes on S3 for storing and processing both structured and unstructured data sets.
Nice-to-have Skills
* Knowledge of open table formats (Iceberg, Delta).
* Experience with Amazon CloudWatch, SNS, Athena, DynamoDB, EMR, and Kinesis.
* Data modelling.
* Job scheduling and orchestration.
* Data virtualisation tools (Denodo).
* ALM tooling (Jira, Confluence).
* CI/CD toolsets (GitLab, Terraform).
* Reporting tools (Business Objects, Power BI, Pentaho BA).
* Data analytics toolset (SAS Viya).
* Observability tools (Grafana, Dynatrace).
Experience
* Senior data engineer with experience delivering large-scale data analytics solutions, operating across all stages of the software engineering lifecycle.
* Awareness of DevOps culture and modern engineering practices.
* Experience delivering using Agile Scrum.
* Proactive, with personal drive, enthusiasm, and a willingness to learn.
* Excellent communication and stakeholder management skills.
* Developing solutions within the given architecture and adhering to specified NFRs.
* Supporting other engineers within the team.
* Continually looking for ways to improve.
J-18808-Ljbffr