Company Introduction
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include
Benchmark,
General Catalyst,
Peter Thiel,
Adam D'Angelo,
Larry Summers, and
Jack Dorsey.
Role Overview
- Position: STEM Expert Contract, Remote
- Commitment: 20 hours per week, Duration: 1 month
- Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry.
Responsibilities
- Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
- Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts and develop a comprehensive rubric.
- Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
- Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.
Requirements / Qualifications
Must-Have Qualifications
- BS or BA in Biology, Physics, or Chemistry
- Familiarity with undergraduate-level biology, physics, chemistry topics
- Strong writing and critical thinking skills
- Ability to work independently and meet deadlines
Preferred Qualifications
- 2+ years of experience in teaching, research, or applied STEM discipline field
Engagement Details
- Remote and asynchronous role
- 20 hours per week commitment
- Duration: 1 month
- Structured project environment with clear goals and tools
Application Process (Takes 20-30 mins to complete)
- Complete an AI-led interview, this should take around 15 minutes
- Complete a 45-minute written assessment that will guide you through writing rubrics
- If selected, you will be invited to work on the project
Resources & Support
- For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
- For any help or support, reach out to: [Confidential Information]
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. 
