The Role
Based in Manchester, you will work as a Data Engineer responsible for designing, building, and maintaining robust data pipelines and data architectures. You will work closely with stakeholders to understand complex data challenges, transform raw data into meaningful insights, and support analytics and reporting. This includes working with batch, streaming, real-time, and unstructured data, applying distributed compute techniques to handle large datasets efficiently.
This is a hybrid role, with time split between the Manchester office and working from home.
Key Responsibilities
1. Develop and maintain data ingestion pipelines and orchestration workflows
2. Design database schemas and data models
3. Integrate and enrich data from multiple sources, ensuring consistency and quality
4. Design and implement ETL/ELT processes (for example using Apache NiFi)
5. Produce reusable, maintainable code with a test-driven approach
6. Maintain and enhance existing data platforms and services
7. Investigate and reso...