STEM Raters for GenAI Data
Role Overview
As a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity, and pedagogical effectiveness, ensuring they are insightful, well-structured, and tailored to the learner's level. You will apply your deep subject matter expertise to provide critical feedback that directly enhances the AI's ability to teach millions at scale through technology.
I. Core Responsibilities
* High-Quality Data Creation & Curation:
* Meticulously create and refine high-quality data, including detailed solutions, explanations, and step-by-step derivations for STEM problems across various difficulty levels.
* Ensure all content adheres strictly to established quality rubrics, style guides, and pedagogical standards, focusing on accuracy, clarity, and effectiveness.
* Integrate subject matter expertise to provide comprehensive and insightful explanations that anticipate common student misconceptions.
* AI Response Evaluation & Feedback:
* Rigorously evaluate AI-generated responses for correctness, coherence, pedagogical soundness, and adherence to specific instructions.
* Provide clear, constructive, and actionable feedback to the AI model, identifying errors, inaccuracies, or areas for improvement in its reasoning and presentation.
* Participate in creating "ground truth" solutions and evaluation datasets to benchmark AI model performance.
* Subject Matter Expertise Application:
* Apply deep knowledge in [Maths/Physics/Chemistry/Biology/Coding/Finance] to assess complex problems, verify solutions, and develop alternative approaches.
* Stay updated with advancements and common curriculum standards in your respective STEM field to ensure content relevance and accuracy.
* Collaboration & Workflow Adherence:
* Work closely with the STEM Lead and fellow raters to ensure consistency in data creation and evaluation processes.
* Adhere to established workflows, deadlines, and project requirements set by the STEM Lead.
* Communicate clearly about challenges encountered in data creation or AI evaluation to facilitate timely resolution.
II. Required Qualifications & Experience
* Educational Background: A Master's degree (M.Sc./M.Tech) in [Maths/Physics/Chemistry/Biology/Coding/Finance] or a closely related field from a premier Tier-1institution. A Ph.D. is a plus.
* Deep Subject Expertise: Demonstrable, strong expertise across a wide range of topics within your subject.
* Teaching/Content Creation Experience: Proven experience (7+ years) in teaching, tutoring, content writing, or academic research in your specialized STEM field. Experience with competitive exam preparation is highly valued.
* Exceptional Communication Skills: Excellent written communication skills with the ability to explain complex concepts clearly, concisely, and accurately.
III. Preferred Qualifications (The "Ideal" Candidate)
* Experience with AI/ML Feedback: Familiarity with providing structured feedback for AI models or large language models.
IV. Personal Attributes & Soft Skills
* Meticulous & Detail-Oriented: An unwavering commitment to accuracy, a keen eye for minute details, and a high standard for quality.
* Pedagogical Aptitude: A natural ability to explain concepts in an easy-to-understand, step-by-step manner, considering different learning styles.
* Analytical & Critical Thinker: Capable of critically evaluating information, identifying logical flaws, and applying analytical reasoning to solve problems.
* Organized, Efficient & Proactive: Able to manage time effectively, prioritize tasks, and consistently meet deadlines in a fast-paced environment. Be a proactive self starter who can problem solve to resolve roadblocks rather than (largely) relying on external support
* Collaborative & Dynamic: Works well in a team setting, is open to receiving and incorporating feedback, and is dedicated to continuous improvement. Comfortably to execute in a continuously changing environment
* Tech-Savvy: Be extremely comfortable using Google Workspace and collaborate real-time with other stakeholders to deliver the end-goal (data points). Highly amenable to working with new tools and platforms for content creation and AI interaction.