Scenario Reviewer - AI Trainer at Mercor

Job Description:

Latest job information from Mercor for the position of Scenario Reviewer - AI Trainer. If the Scenario Reviewer - AI Trainer vacancy in Los Angeles matches your qualifications, please submit your latest application or CV directly through the updated Jobkos job portal.

Please note that applying for a job may not always be easy, as new candidates must meet certain qualifications and requirements set by the company. We hope the career opportunity at Mercor for the position of Scenario Reviewer - AI Trainer below matches your qualifications.

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Training Scenarios - Reviewer (Quality Control)
Type:Contract
Compensation:$80–$105/hour
Location:Remote

Role Responsibilities

• Audit and evaluate richly detailed personas, digital environments, and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
• Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agent's ability to reason, filter, and prioritize without being broken or impossible.
• Identify logical inconsistencies, factual errors, missing context, and technical flaws such as invalid JSON structures within simulated environments.
• Provide clear, constructive, and actionable feedback to scenario designers. Help refine their worlds and improve overall output.
• Document outcomes by logging review outcomes, scores, and feedback clearly in Airtable and Crucible.

Qualifications

Must-Have

• Undergrad degree
• 2+ years professional experience

Preferred

• Editing / QA background — Senior editor, QA tester, technical reviewer, compliance auditor, or peer-reviewer.
• Technical / data comfort — JSON familiarity, Jira/Asana power user, data analyst, SQL/Python exposure.
• Process & Systems thinking — Operations managers, technical PMs, or systems designers with a strong understanding of complex workflows.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Job Info:

• Company: Mercor
• Position: Scenario Reviewer - AI Trainer
• Work Location: Los Angeles
• Country: US

How to Submit an Application:

After reading and understanding the criteria and minimum qualification requirements explained in the job information Scenario Reviewer - AI Trainer at the office Los Angeles above, immediately complete the job application files such as a job application letter, CV, photocopy of diploma, transcript, and other supplements as explained above. Submit via the Next Page link below.