Social network you want to login/join with:
Data Engineer, Kingston upon Hull, East Yorkshire
Client: Athsai
Location: Kingston upon Hull, East Yorkshire, United Kingdom
Job Category: Other
EU work permit required: Yes
Job Views: 4
Posted: 26.08.2025
Expiry Date: 10.10.2025
Job Description:
This role is based in London (Remote).
About the Role
The Data Engineer will play a pivotal role in the organization by designing and implementing robust data pipelines that facilitate efficient data flow and management across various platforms. This position is essential for ensuring the integrity, reliability, and accessibility of our data, which supports critical business decisions and drives insights.
Required Skills
* Proficiency in PySpark and AWS: Strong command of both PySpark for data processing and AWS (Amazon Web Services) for cloud-based solutions.
* ETL Pipeline Development: Experience in designing, implementing, and debugging ETL (Extract, Transform, Load) pipelines, responsible for moving and transforming data from various sources to data warehouses.
* Programming Expertise: Solid understanding of Python, PySpark, and SQL for data manipulation and analysis.
* Knowledge of Spark and Airflow: In-depth knowledge of Apache Spark for big data processing and Apache Airflow for workflow orchestration.
* Cloud-Native Services: Experience designing data pipelines leveraging cloud-native services on AWS for scalability and reliability.
* AWS Services: Extensive knowledge of AWS services such as S3, RDS, Redshift, and Lambda.
* Terraform for Deployment: Proficiency in deploying AWS resources using Terraform.
* CI/CD Workflows: Experience setting up CI/CD workflows with GitHub Actions.
Preferred Skills
* Experience with other cloud platforms like GCP or Microsoft Azure.
* Understanding of data governance and compliance standards.
We are looking for a proactive and detail-oriented Data Engineer passionate about working with data and driving innovation. If you have a strong technical background and a commitment to excellence, we would love to hear from you!
#J-18808-Ljbffr