AI Training Scenarios Reviewer (Quality Control) – Remote Contract

Role Overview

As an AI Training Scenarios Reviewer, you will act as the final quality checkpoint for simulated environments and tasks designed to train advanced AI agents. You will audit detailed digital worlds (e.g., email, messaging, calendars, file systems) and evaluate whether they effectively challenge AI reasoning without introducing errors or inconsistencies.

This role is ideal for individuals with strong QA, auditing, editing, or analytical review experience.

Key Responsibilities

• Review and evaluate AI training scenarios, personas, and digital environments for logical consistency and structure

• Apply detailed grading rubrics to assess quality, realism, and task effectiveness

• Identify errors, inconsistencies, missing context, and technical flaws (e.g., broken JSON structures)

• Provide clear, actionable feedback to improve scenario quality

• Document evaluations, scores, and feedback using structured tools (e.g., Airtable and internal platforms)

What We’re Looking For

• Proven experience in QA, auditing, editing, or reviewing complex content

• Strong analytical thinking and exceptional attention to detail

• Ability to apply structured evaluation frameworks consistently

• Comfortable working with tools such as Airtable, JSON editors, and AI platforms

• Ability to provide structured, constructive feedback

• Self-driven with strong organizational skills

Minimum Requirements:

• Bachelor’s degree

• At least 2 years of professional experience

• Availability for ~40 hours per week

Nice to Have

• Background in editing, QA testing, technical review, or compliance auditing

• Familiarity with JSON structures and data workflows

• Experience with tools like Jira, Asana, SQL, or Python

• Experience in operations, systems design, or process management

Compensation & Terms

• Independent contractor engagement

• Fully remote with flexible working environment

• Project duration may vary based on performance and business needs

• Weekly payments based on services rendered

Equal Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.