QA Manager - £650 outside IR35 - London (3 days per week in the office) - 6 month contract
This is a six‑month contract role with an expectation of being in the office three days per week.
La Fosse are currently supporting a leading organisation undergoing a major AI transformation, and they're looking for an Quality Assurance Manager to help shape and build their entire AI testing and evaluation framework from the ground up.
This is a hands‑on contract role where you’ll define the standards, tools, and methods that ensure their AI products — including LLM-based tools, RAG systems, and third‑party AI platforms — are accurate, reliable, safe, and aligned to user needs.
Key experience:
* Strong background in testing/evaluating AI or software systems, ideally with NLP/LLM exposure
* Running hands‑on testing across prototypes, PoCs, and production tools
* Supporting vendor assessments and POCs with robust test protocols
* Understanding of prompt evaluation, semantic search, hallucination detection, bias analysis, and LLM behavioural nuances
* Experience with tools such as TruLens, HumanLoop, PromptLayer, or similar
* Knowledge of RAG pipelines, embeddings, modern AI architectures, and API integrations (OpenAI, Azure OpenAI, Anthropic, etc.)
* Ability to design structured test regimes in evolving, ambiguous environments
* Excellent communication skills and confidence working with both technical teams and business users
* Proven experience producing frameworks, documentation, and training materials for handover
#J-18808-Ljbffr