Scenario Reviewer - AI Trainer at Mercor

Job Description:

Latest job information from Mercor for the position of Scenario Reviewer - AI Trainer. If the Scenario Reviewer - AI Trainer vacancy in Los Angeles matches your qualifications, please submit your latest application or CV directly through the updated Jobkos job portal.

Please note that applying for a job may not always be easy, as new candidates must meet certain qualifications and requirements set by the company. We hope the career opportunity at Mercor for the position of Scenario Reviewer - AI Trainer below matches your qualifications.

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: AI Training Scenarios - Reviewer (Quality Control)
Type:Contract
Compensation:$80–$105/hour
Location:Remote

Role Responsibilities

• Audit and evaluate richly detailed personas, digital environments, and tasks created by AI Training Scenario Designers. Ensure they are logically sound and properly structured.
• Apply strict rubrics to score scenarios objectively. Ensure tasks challenge an AI agent's ability to reason, filter, and prioritize without being broken or impossible.
• Identify logical inconsistencies, factual errors, missing context, and technical flaws such as invalid JSON structures within simulated environments.
• Provide clear, constructive, and actionable feedback to scenario designers. Help refine their worlds and improve overall output.
• Document outcomes by logging review outcomes, scores, and feedback clearly in Airtable and Crucible.

Qualifications

Must-Have

• Undergrad degree
• 2+ years professional experience

Preferred

• Editing / QA background — Senior editor, QA tester, technical reviewer, compliance auditor, or peer-reviewer.
• Technical / data comfort — JSON familiarity, Jira/Asana power user, data analyst, SQL/Python exposure.
• Process & Systems thinking — Operations managers, technical PMs, or systems designers with a strong understanding of complex workflows.

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form

Resources & Support

• For details about the interview process and platform information, please check:
• For any help or support, reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

#hiringmercor

Job Info:

• Company: Mercor
• Position: Scenario Reviewer - AI Trainer
• Work Location: Los Angeles
• Country: US

How to Submit an Application:

After reading and understanding the criteria and minimum qualification requirements explained in the job information Scenario Reviewer - AI Trainer at the office Los Angeles above, immediately complete the job application files such as a job application letter, CV, photocopy of diploma, transcript, and other supplements as explained above. Submit via the Next Page link below.

Next Page »

  Prep Cook - West Hills Chilis at Chilis

Posted: 5 hours ago

Desc: Role Overview Our Heart of House Team Members are responsible for setting the pace for a great shift, every shift. They provide dependable, fast service that is absolutely Chili''s. If you take pride...

Company: Chilis | Location: Los Angeles

---

  Orthopedic Physician Assistant - Ortho Hand Specialists at Unity MSK

Posted: 17 hours ago

Desc: Los Angeles Orthopedic Surgery Specialists and Advanced Orthopedics, a leading orthopedic health services practice, has built a first-class reputation for the quality of its providers and the top-leve...

Company: Unity MSK | Location: Los Angeles

---

  Locums NP - Cardiology Job in CA at CompHealth

Posted: 2 days ago

Desc: CompHealth services are always free to you. Let us do the heavy lifting and handle the headache of credentialing, travel, housing, and so much more. With the premier staffing agency as your champion,...

Company: CompHealth | Location: Los Angeles

---

  Professional Liability Partner at Lewis Brisbois

Posted: 4 days ago

Desc: Overview The Los Angeles, CA office of Lewis Brisbois, a full-service AmLaw 100 firm, is actively seeking an attorney to join its Professional Liability Practice.The ideal candidate will have strong r...

Company: Lewis Brisbois | Location: Los Angeles

---

  Locums PA - Family Practice Opportunity in California at Weatherby Healthcare

Posted: 5 days ago

Desc: If you are seeking a new opportunity or would simply like to learn more about locum tenens, give Weatherby a call today for details.Initially 2 days/week, transitioning to Mon - Fri, 8 am - 5 pm18 - 2...

Company: Weatherby Healthcare | Location: Los Angeles

---