Job Title: PySpark Data Engineer - Azure
Salary: up to £54,000
Mostly remote
About Us: Join our innovative team where PySpark expertise meets Azure ingenuity. We're passionate about leveraging data to drive business success and looking for a skilled Data Engineer to join us in delivering high-impact solutions.
Key Responsibilities:
* Develop secure, efficient data pipelines using PySpark for ingestion, transformation, and consumption within Azure.
* Ensure data quality and adherence to best practices throughout the pipeline life cycle.
* Design and optimise physical data models to meet business needs and storage requirements.
* Collaborate with cross-functional teams to deliver BI solutions and reporting structures using Power BI.
Experience & Qualifications:
* 2-5 years of experience in designing and implementing PySpark-based data solutions.
* Proficiency in SQL and Azure technologies (Data factory, Synapse).
* Strong understanding of data life cycle management and CI/CD principles.
* Experience working with large, event-based data sets in enterprise environments.
* Excellent communication skills with a passion for leveraging data to drive business value.
Skills & Attributes:
1. Creative problem solver with a proactive a...