GenAI Data Engineer
Location: London / Edinburgh - (Hybrid - 2 days per week in the office)
Day Rate: Market rate (Inside IR35)
Duration: 6 monthsThe Role
We are seeking a highly skilled GenAI Data Engineer to join a forward-thinking team delivering advanced data and AI solutions. This role will focus on designing scalable data platforms and integrating Generative AI capabilities into enterprise systems.Key Responsibilities
* Design, build and maintain scalable data pipelines using PySpark, Python and distributed computing frameworks
* Architect and optimise AWS-based data and AI infrastructure for secure, high-performance data processing
* Develop, fine-tune, benchmark and evaluate GenAI/LLM models, including custom training and inference optimisation
* Implement and maintain Retrieval-Augmented Generation (RAG) pipelines, vector databases and document processing workflows
* Build reusable frameworks for prompt management, evaluation and GenAI operations
* Collaborate with cross-functional teams to integrate GenAI solutions into production environments
* Ensure data quality, governance and operational reliability across systems
Essential Skills & Experience
1. Strong experience with PySpark and large-scale distributed data processing (ETL/ELT pipelines)
2. Advanced SQL expertise, includi...