Remote | AI Response Evaluator — Up to $60/hour

We are sharing a specialised part-time consulting opportunity for analytical professionals with strong critical-reading, reasoning, and written-evaluation skills. This role focuses on reviewing AI-generated responses, identifying weaknesses in reasoning and communication, and producing clear, evidence-based assessments against structured evaluation guidelines. Selected contributors will apply careful independent judgement to nuanced written material across a range of topics. Key Responsibilities Response Evaluation Review AI-generated responses for quality, accuracy, relevance, and reasoning Assess whether responses address the underlying task completely and appropriately Identify logical gaps, unsupported conclusions, inconsistencies, and missed nuances Evaluate both explicit content and important implications or assumptions Apply careful professional judgement rather than relying on surface-level characteristics Critical Reading & Reasoning Analyse complex written material closely and systematically Identify subtle differences in reasoning, interpretation, and argument quality Detect implicit meaning, missing considerations, and weak assumptions Distinguish substantive errors from minor stylistic issues Evaluate whether conclusions are adequately supported by the available information Written Evaluation & Rationale Produce clear, precise, and well-supported written rationales Explain evaluation decisions using specific evidence from the reviewed material Provide substantive feedback that goes beyond general or surface-level observations Communicate weaknesses and strengths objectively and concisely Ensure written assessments remain internally consistent and easy to follow Structured Quality Review Apply detailed evaluation guidelines accurately and consistently Maintain strict attention to task requirements and scoring criteria Make independent judgements when responses are ambiguous or closely matched Provide critical assessments when quality standards are not met Maintain consistency across repeated evaluation tasks Independent Task Execution Follow detailed project instructions without continuous supervision Complete assigned evaluations independently and accurately Maintain high standards of concentration and attention to detail Adapt to different task formats and evaluation frameworks Complete all work without the use of AI writing or assistance tools Ideal Profile Strong analytical and critical-reading skills Ability to identify nuance, implicit meaning, reasoning gaps, and unsupported claims Excellent written communication and ability to produce precise, evidence-grounded rationales Strong attention to detail and ability to apply structured evaluation criteria consistently Sound independent judgement and willingness to provide critical assessments where warranted Ability to work independently and follow detailed task instructions Native English fluency required Bachelor's degree from a top-500 globally ranked university is preferred Comfortable completing all evaluation and written-feedback work without AI writing tools Engagement Details Part-time independent contractor engagement Fully remote Flexible scheduling based on project requirements Compensation: Up to $60/hour Work includes evaluation of AI-generated responses and preparation of structured written feedback Use of AI writing tools or other AI assistance is prohibited when completing project work Projects may be extended, shortened, or concluded based on project needs and performance Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party H1-B and STEM OPT support is unavailable for this engagement About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy .