Remote | AI Data Science Domain Expert — $100–$200/hour

We are sharing a specialised part-time consulting opportunity for experienced Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, and Data Analytics professionals to contribute domain expertise to an advanced AI training and evaluation project focused on analytical reasoning, data quality, prompt development, technical communication, and model-output assessment.

Selected professionals will review and refine AI-generated analytical content, develop and evaluate prompts, assess model outputs against structured rubrics, conduct independent research and fact checking, and translate complex datasets or findings into clear technical and business-facing conclusions. The role is particularly suited to professionals accustomed to producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation. No prior experience in AI training is required.

Key Responsibilities

AI Output & Data Evaluation

• Review AI-generated analytical content and data outputs for accuracy, clarity, and relevance
• Evaluate outputs against project-specific rubrics and professional analytical standards
• Identify factual, quantitative, or interpretive weaknesses
• Assess logical consistency and completeness of model-generated responses
• Provide structured feedback supporting improvements in output quality

Prompt Development & Refinement

• Develop prompts for complex data science and analytical tasks
• Refine existing prompts to improve clarity, specificity, and evaluation value
• Design instructions that test analytical reasoning and data interpretation
• Assess how prompt structure affects model behaviour and output quality
• Contribute to development of robust domain-specific evaluation scenarios

Rubric-Based Model Evaluation

• Assess AI model performance using detailed evaluation criteria
• Apply scoring and review standards consistently across assignments
• Identify edge cases and ambiguous outputs requiring deeper analysis
• Provide clear written justification for evaluation decisions
• Support calibration and quality assurance across evaluation workflows

Data Interpretation & Analytical Reporting

• Interpret complex datasets, analyses, and experimental findings
• Identify meaningful trends, relationships, limitations, and anomalies
• Summarise quantitative findings in clear and actionable formats
• Produce analytical reports and technical summaries
• Translate complex findings for both technical and business audiences

Research & Fact Checking

• Conduct independent research to validate technical and analytical claims
• Fact-check AI-generated outputs and supporting assertions
• Compare findings against reliable technical or research sources where appropriate
• Identify unsupported, outdated, or misleading information
• Document validation findings clearly and precisely

Data Annotation & Quality Assurance

• Annotate data and analytical content according to defined guidelines
• Review labelled examples for consistency and quality
• Apply professional judgement to ambiguous or nuanced cases
• Identify recurring quality issues and recommend improvements
• Support creation of reliable datasets for AI training and evaluation

Technical Documentation & Professional Writing

• Draft and edit research summaries, experiment reports, technical documentation, and analytical materials
• Improve structure, clarity, and precision of written outputs
• Communicate quantitative concepts accurately and concisely
• Review technical content for both analytical quality and readability
• Maintain professional standards across written deliverables

Asynchronous Collaboration

• Collaborate with project leads and other domain specialists
• Share analytical insights and evaluation best practices
• Clarify project requirements and resolve ambiguous cases
• Incorporate feedback into evolving evaluation workflows
• Contribute to consistent quality across distributed project teams

Ideal Profile

• 3+ years of professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, Data Analytics, or a comparable analytical discipline
• Strong critical-thinking and analytical-reasoning skills
• Demonstrated ability to interpret complex quantitative information
• Proven experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation
• Exceptional attention to detail
• Strong professional writing and report-writing skills
• Ability to communicate technical and quantitative concepts clearly
• Experience with data annotation, content review, or rubric-based evaluation is highly desirable
• Strong independent research and fact-checking ability
• Experience with prompt engineering or prompt authoring is advantageous
• Familiarity with AI-output evaluation or model-quality assessment is beneficial
• Experience with RLHF or related human-feedback workflows is advantageous but not required
• Master's, JD, MBA, PhD, or another advanced degree is preferred but not required
• Experience within leading technology companies, research organisations, or similarly rigorous analytical environments is valuable
• No prior AI-training experience is required

Engagement Details

• Part-time independent contractor engagement
• Fully remote
• Compensation: $100–$200/hour
• Work will involve data-science analysis, AI-output evaluation, prompt development, rubric-based review, data annotation, quality assurance, research, fact checking, and technical writing
• Strong analytical reasoning, data interpretation, and written communication are central to this engagement
• Assignments may involve research papers, analytical reports, experiment summaries, technical documentation, datasets, notebooks, model outputs, and structured evaluation rubrics
• Collaboration will primarily occur asynchronously with project leads and other subject-matter experts
• Prior experience with prompt engineering, AI evaluation, or RLHF is helpful but not required
• Project scope, workload, analytical topics, and evaluation standards may evolve depending on project requirements
• Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, research organisation, or other third party

About the Platform

This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams.

By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy