Remote | Psychology Research Specialist (AI Benchmarking) — $40–$55/hour

We are sharing a specialised part-time consulting opportunity for psychologists, behavioural scientists, and academic researchers with advanced expertise in psychological theory, research methodology, psychometrics, human factors, or applied behavioural science. This role supports an AI research initiative focused on developing rigorous academic benchmarks in psychology. Selected experts will author or verify challenging multiple-choice assessment content, evaluate conceptual and empirical accuracy, develop well-supported solution rationales, and help establish high-quality reference standards for advanced AI systems. Key Responsibilities Psychology Question Authoring Create original multiple-choice questions that test deep conceptual understanding rather than surface-level recall Develop challenging problems within relevant areas of psychological expertise Ensure questions are self-contained, precise, unambiguous, and independently solvable Design questions appropriate for undergraduate, advanced undergraduate, and postgraduate difficulty levels Produce one correct answer alongside nine plausible and carefully constructed distractors Question Verification & Academic Review Review pre-written psychology questions for accuracy, clarity, rigour, and completeness Identify conceptual errors, ambiguity, unsupported assumptions, or solvability issues Edit questions and answer choices where required Verify that designated correct answers are supported by psychological theory and empirical evidence Document substantive changes and explain the reasoning behind them Psychological Research & Methodology Apply graduate-level psychological theory and empirical research to assessment design Evaluate study designs, experimental evidence, measurement approaches, and research conclusions Develop questions requiring interpretation of behavioural and psychological data Distinguish between competing theoretical explanations and methodological approaches Ensure assessment content reflects established research standards and current academic literature Psychometrics & Measurement Develop rigorous problems involving psychological measurement and assessment Apply concepts involving reliability, validity, scale construction, and measurement error Evaluate statistical and methodological assumptions underlying psychological instruments Create questions requiring interpretation of psychometric evidence Distinguish technically sound measurement approaches from plausible but flawed alternatives Human Factors & Applied Psychology Develop content involving human factors and engineering psychology Create problems addressing cognition, decision-making, attention, perception, and human-system interaction Apply psychological principles to technology, design, safety, and performance contexts Develop assessment content involving consumer and market psychology Evaluate behavioural reasoning in practical and applied settings Digital Health & Emerging Psychology Domains Develop or review content involving digital health and technology-mediated behavioural interventions Apply psychological research principles to emerging health and behavioural technologies Create assessment content relating to neuromorphic engineering where relevant to cognition and human-system interaction Develop academically rigorous questions involving psychedelic-assisted therapy Ensure emerging-domain content is grounded in reputable empirical research and appropriately framed Academic Research & Benchmark Quality Provide 1–5 academic references per question where required Use reputable sources such as peer-reviewed journals, academic publications, and university repositories Develop clear, structured solution explanations supporting the correct answer Rate question difficulty according to defined Medium, Hard, and Expert standards Help maintain consistent academic quality across benchmark content Contribute to gold-standard evaluation materials used to assess advanced AI capabilities Ideal Profile PhD, PsyD, or current doctoral candidacy in Psychology or a closely related discipline Master's degree may be considered for candidates with exceptional expertise in a relevant subdomain Strong command of graduate-level psychological theory, research methodology, and empirical literature Expertise in one or more areas including Human Factors, Engineering Psychology, Consumer Psychology, Market Psychology, Psychometrics, Digital Health, Psychedelic-Assisted Therapy, or related behavioural-science fields Strong understanding of experimental design, evidence evaluation, and psychological measurement Excellent written English and ability to communicate complex concepts clearly and precisely Academic research publications are highly valued Clinical licensure is advantageous for relevant areas of expertise University-level teaching, assessment design, or examination-development experience is highly valued Strong attention to conceptual precision, methodological validity, and evidence quality Engagement Details Part-time independent contractor engagement Fully remote and asynchronous Expected availability of at least 10 hours per week Flexible scheduling based on project requirements Compensation: $40–$55/hour Contributors may be assigned either question-authoring or question-verification workstreams Projects may be extended, shortened, or concluded based on project needs and performance Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party H1-B and STEM OPT support is unavailable for this engagement About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy .