Job Description: Business Systems Analyst I – Infrastructure Engineering
Contract Duration: 23 March 2026 – 31 December 2026
Location: London, UK
Work Arrangement: On-site
Remuneration: £25.00 Hourly Rate
Overview
Advancements in generative AI have progressed rapidly, but measuring the true quality of AI‑generated content remains a significant challenge. Small variations in model-generated images or videos can greatly affect user experience, highlighting the need for reliable, standardized evaluation methods.
This role supports a team developing comprehensive evaluation frameworks—including manual human ratings, semi-automated assessments, and fully automated metrics—to measure the performance of advanced image and video generative models (e.g., text-to-image, image-to-video, text-to-video). The team is expanding and requires additional analysts to help prototype, refine, and scale these evaluation methodologies.
Key Responsibilities
* Collaborate with the core team to design and prototype human rating workflows and semi‑automatic evaluation protocols for generative AI models.
* Conduct small- to medium-scale in-house human rating sessions for complex or high‑impact evaluation scenarios.
* Partner with engineering teams to analyse evaluation outputs, identify model performance gaps, and summarize findings.
* Work with engineers to define required datasets, mine relevant data, and prepare high‑quality training sets for model iteration cycles.
* Support Program Delivery & Operations (PDO) teams in scaling validated evaluation protocols, including process coordination, auditing, and documentation.
Required Skills
* Strong verbal and written communication abilities.
* Excellent problem‑solving skills and interpersonal effectiveness.
* High attention to detail and an interest in experimental and investigative tasks.
* Ability to work independently and manage time effectively.
* Basic proficiency with Python, Unix, and SQL.
* Foundational understanding of computer vision and generative AI models.
Education & Preferred Experience
* Associate degree or equivalent training in Computer Science, Electronic Engineering, Physics, Bioinformatics, or another STEM field.
* Prior industry experience in software development or testing is advantageous.
* Research experience in areas such as human–computer interaction is a strong plus.
Adecco is a disability-confident employer. It is important to us that we run an inclusive and accessible recruitment process to support candidates of all backgrounds and all abilities to apply. Adecco is committed to building a supportive environment for you to explore the next steps in your career. If you require reasonable adjustments at any stage, please let us know and we will be happy to support you.
#J-18808-Ljbffr