Relomote
Remote JobsRelocation Jobs
Add companySaved
Relomote

Relomote is a job board for remote, hybrid, and relocation jobs — every listing AI-classified for the countries it actually hires from, or the visa and relocation support it offers.

LinkedInCrunchbase

Remote jobs by category

  • Remote Engineering & Development jobs
  • Remote Customer Support jobs
  • Remote Design jobs
  • Remote Marketing jobs
  • Remote Sales jobs
  • Remote Product jobs
  • Remote Data & Analytics jobs
  • Remote People & Talent jobs
  • Remote Writing & Content Creation jobs
  • Remote Finance jobs
  • Remote Legal & Compliance jobs
  • Remote Operations & Admin jobs
  • Remote Data Entry jobs
  • Remote Virtual Assistant jobs
  • Remote Education/Training jobs
  • Remote Healthcare/Clinical jobs
  • Remote Other jobs

Remote jobs by location

  • Work from anywhere jobs
  • Remote jobs in Africa
  • Remote jobs in Asia
  • Remote jobs in Europe
  • Remote jobs in Latin America
  • Remote jobs in Middle East
  • Remote jobs in North America
  • Remote jobs in Oceania
  • All remote jobs →

Relocation & visa sponsorship

  • Visa sponsorship jobs
  • Relocation package jobs
  • Relocate to Europe
  • Relocate to Germany
  • Relocate to Netherlands
  • Relocate to Spain
  • Relocate to Portugal
  • Relocate to Greece
  • Relocate to United Kingdom
  • Relocate to Canada
  • Relocate to Australia
  • Relocate to Sweden
  • Relocate to Switzerland
  • Relocate to Japan
  • Relocate to United Arab Emirates
  • All relocation jobs →

© 2026 RelomoteAboutPrivacyTerms

Contact [email protected] · Built by Mahmoud

Relomote
Remote JobsRelocation Jobs
Add companySaved
WA

AI Evaluation Specialist

Weekday AI
Posted 2 weeks ago
🇺🇸United States🏠Remote💰$70.0/hr📁Data & Analytics
Is this job info correct?

This role is for one of our clients Compensation: $70 per hour Join a cutting-edge AI research initiative focused on improving the quality, accuracy, and reasoning capabilities of next-generation artificial intelligence systems. We are seeking analytical professionals with exceptional critical thinking and communication skills to evaluate AI-generated responses across a variety of topics. In this role, you will assess AI outputs, identify strengths and weaknesses in reasoning, and provide structured, evidence-based feedback that helps improve model performance. This opportunity is ideal for individuals who enjoy careful analysis, attention to detail, and working independently on intellectually challenging tasks. This is a fully remote, contract-based opportunity with flexible working hours. Key Responsibilities Evaluate AI Responses Review AI-generated content for accuracy, logical reasoning, completeness, and clarity. Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions. Assess responses using structured evaluation frameworks and detailed quality guidelines. Provide High-Quality Feedback Write clear, concise, and evidence-based rationales explaining evaluation decisions. Highlight both strengths and areas for improvement in AI-generated outputs. Apply consistent judgment across a wide range of evaluation tasks. Maintain Evaluation Quality Follow detailed project instructions and standardized assessment criteria. Ensure evaluations are objective, accurate, and reproducible. Complete assignments independently while maintaining high quality standards. Required Qualifications Bachelor's degree from a globally recognized university (top-ranked institutions preferred). Excellent analytical thinking and problem-solving abilities. Strong written communication skills with the ability to explain complex reasoning clearly and precisely. Exceptional critical reading skills, including the ability to identify: Nuanced arguments Implicit meaning Logical inconsistencies Missing context Weak or unsupported reasoning Strong attention to detail and ability to consistently apply structured evaluation guidelines. Ability to work independently and manage assigned tasks efficiently. Native-level English fluency. Preferred Qualifications Experience in content evaluation, research, quality assurance, editing, or analytical review. Familiarity with artificial intelligence, large language models, or AI evaluation methodologies. Experience working with structured annotation or assessment frameworks. Ability to produce thoughtful, objective, and well-supported written evaluations under defined quality standards. Engagement Details Independent contractor engagement. Fully remote with flexible working hours. Work completed on your own schedule. Project duration may be extended, shortened, or concluded based on business needs and performance. Weekly payments processed through supported payment platforms. Why Join Contribute to the development of next-generation AI technologies. Help improve the reasoning, accuracy, and reliability of advanced AI systems. Work on intellectually engaging projects with real-world impact. Collaborate indirectly with leading AI researchers through high-quality evaluation work. Equal Opportunity Statement All qualified applicants will be considered without regard to legally protected characteristics. Reasonable accommodations are available upon request. Contract Information Independent contractor engagement. Fully remote work completed on your own schedule. Weekly payments are processed based on approved work completed. Work does not involve access to confidential or proprietary information from any employer, client, or institution. Please note that visa sponsorship is not available for this opportunity.

Similar jobs

Similar jobs

RB

Player Evaluation Specialist

Reliance Baseball

🇺🇸United States3 days ago
WO

Impact Evaluation Specialist II

Woundedwarriorproject

🇺🇸United States6 days ago
Volga Partners logo

Claims Auditing Subject Matter Expert | AI Evaluation Specialist (On-Call)

Volga Partners

🇺🇸United States2 weeks ago
Volga Partners logo

Insurance Risk Subject Matter Expert | AI Evaluation Specialist (On-Call)

Volga Partners

🇺🇸United States2 weeks ago
WA

Medical Expert AI Evaluation Specialist

Weekday AI

🌍Canada, United States2 weeks ago
WA

Internal Medicine AI Evaluation Specialist

Weekday AI

🌍Canada, United States2 weeks ago