Data Evaluation Analyst (Remote)

• Role: Data Evaluation Analyst (Remote)
• Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
• Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting analytical contributors to determine whether project data is fit for its intended AI use. You will assess evidence, representativeness, and task alignment, then document the strengths and limitations of each example.

Key Responsibilities

- Evaluate whether a data example contains enough information to support its expected decision or output.

- Check that the example reflects the task definition rather than an unrelated or misleading pattern.

- Assess source support, clarity, difficulty, and ambiguity as separate evaluation dimensions.

- Compare similar examples to identify inconsistent outcomes or unhelpful redundancy.

- Summarize why an item should be accepted, revised, excluded, or escalated under the data criteria.

Requirements

- Must be at least 18 years old and able to communicate in English.

- Ability to evaluate whether data examples are informative, supported, and aligned with a defined task.

- Ability to separate source quality, ambiguity, difficulty, and redundancy in an analysis.

- Reliable high-speed internet and a suitable home-working setup.

- Previous experience with data evaluation, analytical review, or AI datasets is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!