We are sharing a specialised part-time consulting opportunity for board-certified psychiatrists with substantial independent clinical experience and strong expertise in diagnostic reasoning, differential diagnosis, risk assessment, and complex psychiatric cases. This role supports an advanced AI research project focused on evaluating how large language models reason through challenging psychiatric scenarios. Selected psychiatrists will design expert-level clinical problems, develop authoritative reference answers, and identify important failure modes in AI-generated psychiatric reasoning. Key Responsibilities Advanced Psychiatric Case Design Develop challenging psychiatric cases that test advanced diagnostic and clinical reasoning Create scenarios involving nuanced differentials, atypical presentations, and competing diagnoses Incorporate realistic clinical uncertainty and incomplete information where appropriate Design cases that expose weaknesses in current AI reasoning Ensure tasks reflect real-world psychiatric practice and professional standards Diagnostic & Clinical Reasoning Evaluate psychiatric presentations using structured clinical reasoning Develop gold-standard diagnostic interpretations and differential diagnoses Explain how relevant symptoms, history, examination findings, and contextual factors affect clinical conclusions Identify misleading or insufficient reasoning in AI-generated responses Apply expert judgement to cases where multiple plausible interpretations must be distinguished Risk Assessment & Clinical Decision-Making Develop and review scenarios involving psychiatric risk assessment Evaluate reasoning around safety, urgency, escalation, and appropriate next steps Incorporate nuanced considerations relevant to complex psychiatric presentations Assess whether AI systems appropriately recognise high-risk findings Identify common errors in model reasoning around clinical risk and prioritisation Gold-Standard Answer Development Produce authoritative reference answers with clear clinical reasoning Explain the basis for diagnostic and management conclusions Highlight critical distinctions that separate strong from weak clinical responses Develop responses suitable for benchmarking advanced AI systems Maintain high standards of clinical accuracy, clarity, and completeness AI Model Evaluation Review AI-generated responses to advanced psychiatric cases Identify recurring reasoning errors, omissions, and unsafe assumptions Compare model behaviour against expert clinical standards Provide structured feedback to research teams Help improve evaluation criteria for psychiatric reasoning tasks Subspecialty Expertise Apply specialist knowledge where relevant across areas such as: Addiction Psychiatry Child & Adolescent Psychiatry Forensic Psychiatry Geriatric Psychiatry Consultation-Liaison Psychiatry Contribute subspecialty cases reflecting realistic clinical complexity Apply fellowship, board, or substantial practice-based expertise to specialised scenarios Ideal Profile Medical degree: MD, DO, or recognised international equivalent Completed psychiatry residency through ACGME, AOA, or recognised national equivalent Active board certification in psychiatry, such as ABPN, FRCPC, MRCPsych, FRANZCP , or recognised national equivalent Active and unrestricted medical licence At least 3 years of independent psychiatric practice after residency , currently or within the last two years Professional practice within an accredited or government-licensed hospital, academic centre, community clinic, private practice, or telehealth setting Based in the United States, United Kingdom, Europe, or Australia , with US-based candidates particularly welcome Strong expertise in psychiatric diagnosis, differential diagnosis, risk assessment, and clinical reasoning Current direct patient-care experience is highly valued Fellowship, subspecialty certification, or 2+ years of focused practice in a psychiatry subspecialty is advantageous Experience developing or examining OSCEs is advantageous Current or recent faculty appointment within a psychiatry department is advantageous Strong written communication and ability to explain complex clinical reasoning precisely Engagement Details Part-time independent contractor engagement Fully remote Flexible scheduling based on project requirements Compensation: Up to $140/hour Initial screening includes a 20–30 minute interview covering clinical background and subspecialty expertise Contributors may collaborate directly with AI research teams Projects may be extended, shortened, or concluded based on project needs and performance Work must be completed without using confidential or proprietary information belonging to any employer, patient, client, institution, or other third party H1-B and STEM OPT support is unavailable for this engagement About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy: https://www.24-mag.com/privacy-policy .
Remote | Architectural Design & Documentation Expert — Up to $65/hour
24-MAG
Remote | US GAAP Accounting & Financial Reporting Expert — Up to $75/hour
24-MAG
After Hours Supervisor
Homeinstead Greenbay
After-Hours IT Support Desk Technician
The20
Director of Data Science Production Engineering, Extended-Hours Support
Empleos en Natera
Behavior BCBA | Up to $90/Hour + Flexible Hybrid Schedule
BK Behavior