Data Engineer
Remote working, West Sussex, Manchester
Up to £54,000 per annum + Bonus
An exciting opportunity has arisen to join a leading company in the Insurance and technology sector, renown for its outstanding working culture, in a Data Engineering role. The role will require someone who has strong Pyspark and SQL experience alongside an Azure background.
Key responsibilities:
* Develop low to high complexity, secure, governed, high quality, efficient data pipelinesfrom a variety of on and off premise, internal and external data sources
* Ensure that data is cleansed, mapped, transformed and optimised for storage to meet requirements for business and technical use cases.
* Build data observability and data quality by design into all Data pipelines, promoting self-testing pipelines that proactively identify processing issues or discrepancies.
* Build solutions that pipe transform data into data lake storage areas, physical databasemodels and reporting structures across data lake, data warehouse, business intelligence systems and analytics applications.
* Build physical data models that are appropriately designed to meet business needs and optimise storage requirements, ensuring maximum re-use.
* Carry out unit testing of own code, and peer testing of others code to ensure appropriate quality
* Maintain effective, and appropriate documentation that brings transparency and understandability to pipelines created and code created.
* Create high complexity BI solutions including data mart, semantic layer, and reporting & visualisation solutions in recognised BI tools such as PowerBI.
Skills required:
* Strong experience with SQL server and/or Azure (Synapse, Datafactory)
* Pyspark
* Experience of designing and building end to end data solutions
* A good understanding of the full data lifecycle
* The ability to coach/mentor junior Data Engineers
* Power BI
* Terraform (desirable)
This company have an outstanding culture and a fast paced, entrepreneurial way of working, which is generally a breath of fresh air to their employees. They have also adopted flexible working which can be discussed and tailored to candidates at interview and offer a bonus and generous benefits package.
If you are interested, please apply for full details.