Overview
Salary: Up to £80,000 + 20% Bonus + 20% Pension
Work Type: 12-month FTC – Highly likely to extend or go permanent
Location: Central London – Hybrid
This is an exciting opportunity to join a prestigious financial organisation as they embark on a major AI campaign. Having completed their digital and data transformation programme, the organisation now operates in an Azure cloud environment and is making significant progress in AI, with engineers developing LLMs and agents within Azure. There is currently no dedicated capacity to test these AI solutions. As the AI Test Manager, you will be responsible for implementing robust test frameworks for GenAI and LLMs while ensuring compliance with relevant regulations and standards. You will work with QA, AI Engineering, Data Enablement, and Project Management across the organisation, which has around 500 employees.
Responsibilities
* Implementing test frameworks for AI solutions - Generative AI (GenAI)
* Tested Large Language Models (LLMs) - ideally in production
* Work in heavily regulated environments (e.g., Financial Services, Banking, Insurance, Utilities), ensuring compliance with sector and AI-related requirements
* Familiarity with Azure DevOps, CI/CD, Git, and Jira
Qualifications / Ideal Candidate
* The ideal candidate will be pragmatic, proactive, and an excellent communicator, able to engage effectively with a wide range of stakeholders
* Experience implementing robust test frameworks for AI solutions and GenAI
* Experience testing LLMs, ideally in production
* Experience in heavily regulated environments and ensuring compliance with sector and AI-related requirements
* Familiarity with Azure DevOps, CI/CD, Git, and Jira
Job Details
* Seniority level: Mid-Senior level
* Employment type: Contract
* Job function: Information Technology, Consulting, and Analyst
* Industries: Financial Services, Banking, IT Services and IT Consulting
If you’re interested, please apply directly with an up-to-date copy of your CV and we’ll be in touch.
#J-18808-Ljbffr