dological and conceptual errors and provide concise expert feedback.
• Create and quality-check Mandarin Chinese prompts, constraints, and acceptance criteria for Python coding and debugging scenarios.
• Annotate common Python error patterns with consistent Chinese and English labels.
• Apply detailed evaluation rubrics consistently across many samples.
What you bring
• 1–5 years of relevant Python development, code review, debugging, or technical problem-solving experience.
• Bachelor's degree in Computer Science, Software Engineering, a related field, or equivalent practical experience.
• Fluent Mandarin Chinese and the ability to evaluate technical content written in Chinese; Traditional Chinese is preferred.
• English proficiency at CEFR C1 level or above.
• Strong Python 3.x fundamentals and practical debugging ability.
• Prior AI training, annotation, or AI-output evaluation experience is preferred.
• A detail-oriented, self-directed working style suited to flexible remote contract work.
Role details
• Company: Vraify
• Employment type: Independent contractor, hourly
• Location: Remote
• Schedule: Flexible
• Pay: USD $10–18 per hour
Why join Vraify
• Flexible remote contract work.
• Direct impact on the technical accuracy and bilingual clarity of real AI systems.
• Clear rubrics and calibration support.
• Apply Mandarin Chinese and Python expertise in a structured evaluation workflow.Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.