Work from home generalist roles in India supporting AI/ML training pipelines. You will combine data labeling, RLHF evaluation, prompt evaluation, and QA evaluation across NLP, computer vision annotation, and content safety labeling while ensuring audit-ready, guideline-compliant outputs.
Key Responsibilities
Perform NLP annotation (e.g., named entity recognition, text classification) and computer vision annotation (boxes, polygons, segmentation)
Execute RLHF preference ranking to support large language model training
Conduct prompt evaluation to identify instruction-following issues, hallucinations, and policy gaps
Run QA sampling, audits, and checks to ensure annotation guidelines compliance
Document edge cases, propose guideline clarifications, and report systematic errors
Apply consistent content safety labels and moderation judgments
Maintain throughput while protecting accuracy, consistency, and reviewability
Required Qualifications
Mid-Senior experience in operations, analytics, or data-centric workflows
Strong English reading comprehension and careful reasoning
Ability to follow complex annotation guidelines and make consistent judgments
Comfort with repetitive tasks, quality targets, and QA feedback loops
Proficiency with web tools and spreadsheets; reliable internet for remote work
Preferred Qualifications
Experience with RLHF, LLM evaluation, prompt evaluation, or content moderation