Role Overview:
We are hiring for one of our clients, seeking a Small business owners (AI response evaluation) - Korean Business Document to work on a full-time basis. Evaluate and compare the quality of responses from multiple AI chatbots across real-world small business use cases. Create realistic business-related prompts based on defined user goals and assess response quality across clarity, usefulness, and accuracy.
Key Responsibilities:
• Create realistic business-related prompts aligned with defined small business user goals.
• Interact with up to five AI chatbots per conversation to gather comparative response data.
• Assess AI response quality using structured criteria including clarity, usefulness, and accuracy.
• Provide detailed feedback and comparative evaluations for each evaluated conversation.
• Submit conversation transcripts and structured evaluation results for review.
Required Skills & Qualifications:
• Must have business-related documents available in Korean.
• Strong analytical and critical thinking skills to evaluate AI responses objectively.
• Ability to follow structured evaluation guidelines and maintain consistency across tasks.
• Comfortable interacting with AI tools and interpreting AI-generated outputs.
• Experience with tools such as spreadsheets, PDFs, and images to support evaluation workflows.
More About the Opportunity:
This role offers a unique opportunity to work with a global leader in the Technology, Information and Internet industry, contributing to the advancement of AI systems. The work involves high-impact projects that support mission-critical priorities for companies in the AI ecosystem.
Equal Opportunity Employer:
We hire based on skills and expertise. All qualified candidates are welcome regardless of background, experience, or prior employment history. Applications are reviewed solely on demonstrated technical ability and qualifications.
Apply Now!
Customer Success Operations Evaluator
Mercor
Finance Operations Expert - Evaluator
Mercor
SAP ABAP Consultant
Syntax
Sr. Manager, Project Management
ResultsCX
Assistant Procurement Manager
Flexiple
Service Operations Manager
Flexiple