CO

Subject Matter Expert – AI Evaluation | $155/task

CodefeastApplies on LinkedInData & Analytics
Hiring from
Saudi Arabia
Work type
Remote
Posted

626,022 remote jobs, straight from company career pages

100% free · New jobs every minute

Show job description

Subject Matter Expert – AI Conversation Evaluation


Experience: 3–5+ Years

Job Type: Contract

Location: Remote

Compensation: $155 per task

Domain: Psychology | Social Work | Counseling | Qualitative Research | HCI | Communication | Coaching | Mediation


Role Overview

We are looking for experienced Subject Matter Experts (SMEs) to review AI conversations involving interpersonal, advisory, and everyday decision-making scenarios.

The role involves assessing whether the AI gathered enough context before making recommendations and identifying missed clarification opportunities.


Key Responsibilities

  • Review conversations between users and AI models.
  • Identify missing or important context.
  • Suggest relevant follow-up questions.
  • Evaluate whether additional information could change the recommendation.
  • Distinguish critical / load-bearing context from non-essential details.


Key Requirements

  • 3–5+ years of direct professional experience in one or more relevant areas.
  • Background in Social Work, Counseling, Psychology, HCI, Qualitative Research, Communication, Coaching, Mediation, Student Services, or Organizational Consulting.
  • Strong interviewing, assessment, qualitative analysis, or client-facing experience.
  • Ability to understand complex personal or organizational situations and identify missing context.


Preferred Backgrounds

  • Licensed Social Workers: MSW, LCSW, LICSW, LMSW or equivalent.
  • Counseling / Psychology: LMFT, LPC, LCPC, PhD, PsyD or equivalent.
  • Research / HCI: Qualitative Research, UX Research, Communication, Anthropology, Sociology.
  • Advisory Fields: Coaching, Mediation, Student Services, Organizational Consulting.


Apply for this job100% free