Overview
Screener Criteria: LinkedIn profile verification required for eligibility
Start Date: TBC
End Date: TBC
Location: Remote (UK/US/CA/AUS)
Type of contract: freelance
Hourly Rate: $40+/hr
Minimum Hours: TBC from Services
Maximum Hours: Subject to availability
Screening compensation: $46/hr (for eligibility test/screener)
The role
We are seeking Computer Science Domain Experts to act as evaluators for a high-level AI verification project. AI models are now generating complex technical summaries, and we need specialists to ensure these outputs maintain scientific integrity and factual accuracy. We need experts who can navigate dense scientific literature to judge the accuracy and structural integrity of AI-generated graphical abstracts. This is a flexible, ad hoc project where your technical expertise directly influences how AI understands and summarizes complex computer science research.
What you’ll be doing
* Scientific Review: review computer science scientific papers alongside LLM-generated graphical abstracts.
* Fact-Checking: identify issues and inaccuracies where the graphical abstract does not faithfully represent the source scientific paper.
* Expert Verification: use your domain knowledge to ensure that technical concepts are visually and textually summarized correctly.
* Quality Control: help refine the model's ability to produce "enterprise-ready" scientific summaries.
What you’ll bring
* Advanced Academic Credentials: hold a Master’s or PhD in Computer Science.
* Domain Expertise: specialized knowledge in STEM/Computer Science fields.
* Analytical Skills: history with fact-checking tasks and a high level of basic cognitive competency.
* Verification: a valid LinkedIn profile is required to verify your credentials during the screening process.
* Previous experience with AI-related training or evaluation tasks.
* Background in scientific publishing or peer review.
Why join this project?
This is a unique opportunity to act as an expert in the AI-driven scientific revolution. You’ll be teaching the model how to accurately synthesize complex data, providing the technical rigor that algorithms currently lack.
Notes
Please note that you must be new to Prolific to sign up successfully. If you already have a Prolific account, there is no need to register again; simply ensure your profile is up to date to be eligible for opportunities.
Why Prolific is a great platform to join as an expert participant
Joining our platform as a participant will give you the chance to influence the AI models of the future. Once you pass our assessment, you can join Prolific in just 15 minutes and start enjoying competitive pay rates, flexible hours, and the ability to work from home.
We’ve built a platform that connects researchers and companies with a global pool of participants, enabling the collection of high-quality, ethically sourced human behavioral data and feedback. This data is the cornerstone of developing more accurate, nuanced, and aligned AI systems.
We believe that the next leap in AI capabilities won't come solely from scaling existing models, but from integrating diverse human perspectives and behaviors into AI development. By providing this crucial human data infrastructure, Prolific is positioning itself at the forefront of the next wave of AI innovation – one that reflects the breadth and the best of humanity.
Links to more information on Prolific
* Website
* YouTube
Privacy Statement
By submitting your application, you agree that Prolific may collect your personal data for recruiting and global organization planning. Prolific's Candidate Privacy Notice explains what personal information Prolific may process, where Prolific may process your personal information, its purposes for processing your personal information, and the rights you can exercise over Prolific's use of your personal information.
#J-18808-Ljbffr