Get AI-powered advice on this job and more exclusive features.
Direct message the job poster from SThree
SThree is excited to announce an opportunity for a talented AI Test Automation Engineer to join our dynamic team. You’ll be based in one of our fantastic office spaces in Glasgow or London, working in a collaborative environment where your expertise will make a real impact.
As the AI Test Automation Engineer, you will design and implement automated testing frameworks to validate the safety, reliability, and robustness of AI agents across our orchestration platform. This is an opportunity to join a high functioning relaxed team that will significantly contribute to the digital transformation at SThree.
Who will you be working for?
SThree is the global STEM‑workforce consultancy. We connect sought‑after specialists with dynamic organisations around the world. We advise businesses, build expert teams, and deliver project solutions to drive innovation across STEM sectors, helping them to Outpace tomorrow, together.
Key expectations of this role
* Design and implement automated testing frameworks to validate the safety, reliability, and robustness of AI agents across our orchestration platform.
* This includes unit and integration tests, scenario simulation, and adversarial validation for prompt injection, hallucinations, and edge cases.
* You’ll also simulate failure scenarios, manage synthetic input testing, and support blue team efforts in early-stage detection of model or orchestration misbehaviour.
* LLM behaviour testing, including misuse and injection detection.
* Blue team and adversarial scenario simulation design.
* CI/CD integration with Azure DevOps for continuous testing.
* Python/YAML scripting for scenario and agent validation.
* Experience with AI safety test harnesses or red team inputs.
Remote Working
* Expected to be in the office 1 to 2 days a week. With additional days depending on activity (e.g. a design workshop).
Benefits for our U.K. teams
* The choice to work flexibly from home and the office, in line with our hybrid working principles.
* Bonus linked to company and personal performance.
* Generous 28 days holiday allowance, plus public holidays.
* Annual leave purchase scheme.
* Five days paid Caregiver/Dependent leave per annum.
* Five paid days off per year for volunteering.
* Private healthcare, discounted dental insurance and health care cashback scheme.
* Opportunity to participate in the company share scheme.
* Access to a range of retail discounts and saving.
What we stand for
We’re committed to ensuring that all processes are equitable, and everyone is treated with fairness and dignity where everyone belongs, is valued and connected. If you need any assistance or reasonable adjustments in submitting your application please let us know, and we’ll be happy to help.
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Information Technology
Industries
Business Consulting and Services
#J-18808-Ljbffr