CO
Subject Matter Expert – AI Evaluation | $155/task
- Hiring from
- Saudi Arabia
- Work type
- Remote
- Posted
626,022 remote jobs, straight from company career pages
100% free · New jobs every minute
Show job descriptionHide job description
Subject Matter Expert – AI Conversation Evaluation
Experience: 3–5+ Years
Job Type: Contract
Location: Remote
Compensation: $155 per task
Domain: Psychology | Social Work | Counseling | Qualitative Research | HCI | Communication | Coaching | Mediation
Role Overview
We are looking for experienced Subject Matter Experts (SMEs) to review AI conversations involving interpersonal, advisory, and everyday decision-making scenarios.
The role involves assessing whether the AI gathered enough context before making recommendations and identifying missed clarification opportunities.
Key Responsibilities
- Review conversations between users and AI models.
- Identify missing or important context.
- Suggest relevant follow-up questions.
- Evaluate whether additional information could change the recommendation.
- Distinguish critical / load-bearing context from non-essential details.
Key Requirements
- 3–5+ years of direct professional experience in one or more relevant areas.
- Background in Social Work, Counseling, Psychology, HCI, Qualitative Research, Communication, Coaching, Mediation, Student Services, or Organizational Consulting.
- Strong interviewing, assessment, qualitative analysis, or client-facing experience.
- Ability to understand complex personal or organizational situations and identify missing context.
Preferred Backgrounds
- Licensed Social Workers: MSW, LCSW, LICSW, LMSW or equivalent.
- Counseling / Psychology: LMFT, LPC, LCPC, PhD, PsyD or equivalent.
- Research / HCI: Qualitative Research, UX Research, Communication, Anthropology, Sociology.
- Advisory Fields: Coaching, Mediation, Student Services, Organizational Consulting.