AI Test engineer
Cambridge, United Kingdom
Contract
Competitive
AI Test Engineer
Day Rate: £200-£250 per day (Outside IR35)
Location: Cambridge
Contract: 6-month initial contract - high possibility for 18 months.
About the Role
Our client is hiring an experienced AI Test Engineer to join a prestigious organisation as part of our Core AI Services team. This role is focused on ensuring the reliability, security, and performance of distributed, cloud-native services and public APIs that underpin enterprise-scale AI systems. You’ll work in a fast-paced Scrum team alongside developers, architects, and data scientists to build automated testing frameworks, AI evaluation tools, and validation strategies. If you thrive on experimentation, problem-solving, and building robust systems that scale, this is the opportunity for you.
Key Responsibilities
1. Test and validate cloud-native services deployed on Microsoft Azure.
2. Build and maintain automated test suites for APIs, service components, and AI pipelines.
3. Automate evaluation of AI outputs for accuracy, safety, and consistency.
4. Define quality metrics and observability hooks in collaboration with engineering teams.
5. Ensure compliance with AI regulations and standards such as NIST AI RMF and the EU AI Act.
6. Conduct threat modelling and security testing for APIs and AI services.
7. Provide early feedback to improve design and reduce defects.
8. Mentor junior engineers and contribute to a culture of innovation and continuous improvement.
Skills & Experience
9. 12+ years in software testing and validation for cloud-native applications using Microsoft and .NET.
10. Expertise in automated testing frameworks such as Selenium, Postman, JMeter, or custom-built solutions.
11. Hands-on experience with Azure DevOps, CI/CD pipelines, and containerized environments (Docker, Kubernetes).
12. Strong knowledge of API testing, performance profiling, and security practices including OWASP Top 10 and penetration testing.
13. Familiarity with AI/ML systems, including LLM evaluation techniques, output scoring, and validation frameworks.
14. Understanding of prompt engineering, RAG, model orchestration, and hallucination detection.
15. Awareness of ethical AI, bias detection, explainability, and regulatory compliance.
16. Proven ability to work in Agile teams, solve complex problems, and mentor junior team members.
What You’ll Gain
17. Join a team building cutting-edge AI systems at enterprise scale.
18. Collaborate in a global R&D environment with experts across domains.
19. Contribute to the development of ethical, trustworthy, and future-ready AI services.
20. Enjoy competitive day rates with a contract Outside IR35.