About Grayde
Grayde.ai is a specialised healthcare and life science AI data and evaluation company. We work with the best clinicians and life science researchers to make medical AI models better.
Overview
Rank pairs of AI-generated drug information responses as RLHF preference data, judging clinical accuracy, completeness, and appropriate sourcing against a scoring rubric.
About this job
We're seeking medical information/drug information specialists to produce preference-ranking data for RLHF by comparing AI-generated responses to HCP and patient drug queries, covering dosing, interactions, contraindications, and off-label use questions. You will judge which responses are most accurate, complete, and appropriately sourced, ranking them according to a defined rubric.
You will use authoritative drug information resources and clinical databases such as DrugBank, Micromedex, Lexicomp, FDA drug labeling, and PubMed to validate AI-generated responses and support evidence-based ranking decisions.
Your rankings will train the model's reward signal, so consistency and clear rationale matter as much as the final ranking.
What you'll do
1. Rank multiple AI-generated drug information responses by quality to produce RLHF preference pairs.
2. Verify dosing, interaction, and contraindication accuracy.
3. Assess whether responses appropriately cite evidence or labelling.
4. Use drug information databases such as DrugBank, Micromedex, Lexicomp, and FDA labelling to validate medication information.
5. Check handling of off-label and unapproved-use questions.
6. Flag responses that could mislead a prescriber or patient.
7. Apply a structured rubric consistently across ranking batches.
8. Write comparative rationale explaining each preference judgment.
Who can apply
Degree: MBBS / MBChB (Primary medical), MD (Doctor of Medicine), BPharm / MPharm, PharmD, MN / MSN (Nursing)
Field of study: Pharmacology, Toxicology, Pharmacy (General), Pharmaceutical Sciences, Clinical Pharmacy, Pharmacovigilance
English level required: Full professional fluency
Please complete your grayder.ai profile to be considered.
Clinical Data Manager
Precision for Medicine
Ejecutivo de Medios
Havas
Chat Rep I-Customer Service (VB)
American Express
Analyst, A/R
Warnerbros
Senior Analyst, Technology Procurement
Warnerbros
Talent Acquisition Partner - FMCG
Henkel