Remote Data Labeling Jobs in Warsaw

About The Role

Rex.zone is hiring for full-time, fully remote data labeling and evaluation roles supporting AI/ML development. You will create and validate labeled datasets used in NLP, computer vision annotation, content safety labeling, and LLM training pipelines, with a strong emphasis on training data quality and annotation guidelines compliance.

What You Will Do

• Execute text annotation tasks (classification, named entity recognition) and multimodal labeling (image/video/audio)
• Perform rubric-based large language model evaluation, including prompt evaluation and response grading
• Complete RLHF-style preference tasks (pairwise ranking, rationale capture) aligned to evaluation rubrics
• Run QA evaluation workflows (spot checks, gold set validation, sampling audits, disagreement analysis)
• Document edge cases, flag policy/privacy issues, and support content safety labeling escalations
• Collaborate asynchronously with project leads to clarify guidelines and improve dataset consistency
  
  

Requirements

• Mid-senior experience in data annotation, data labeling, or evaluation work with measurable quality targets
• Strong attention to detail and ability to interpret and follow annotation guidelines
• Familiarity with QA evaluation concepts (gold data, audits, disagreement analysis)
• Comfort working full-time remote with reliable connectivity and secure work practices
  
  

Compensation

$30–$50 per hour (USD), HOURLY, base salary, depending on skills alignment and evaluation complexity.

How To Apply

Apply via Rex.zone and highlight experience with data labeling, RLHF, prompt evaluation, QA evaluation, and training data quality.