Physician, Medical AI Evaluation
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
US-licensed physicians evaluating clinical EHR cases for Mindrift’s medical AI projects. Flexible task-based work assessing diagnoses, treatments, and clinical reasoning.
Responsibilities:
- Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor trap answers across diagnosis and treatment tasks
- Assess cases spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems
- Score clinical reasoning quality, vignette accuracy and completeness, answer correctness and gradeability, and trap quality
- Check whether reasoning reaches the answer from vignette facts alone
- Correct reasoning traces and write short rationales
- Participate in three independent blind reads and physician adjudication
- Complete flexible, project-based tasks through the platform
- Pass qualification(s), complete approved tasks, and receive payment
Requirements:
- Medical degree (MD or DO)
- Active, unrestricted US medical license, verified at onboarding and re-checked monthly
- Board certification or completed residency training
- Direct patient care experience; attending-level preferred
- Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine
- Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines
- Strong written English (C1+)
- Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA is a plus
- Must be a US-licensed physician based in an eligible US state
- Not suitable for medical students, unlicensed medical graduates, non-physician clinicians, or non-clinical healthcare titles
Benefits:
- Earnings per approved task at a fixed rate set in advance
- Fully self-scheduled work with no minimum hours or set schedule
- Remote work
- No patient contact or malpractice exposure
- $50 one-time onboarding reward, paid once the first task is approved
- Quality incentives for high-quality approved tasks
- Higher per-task rates for QA and adjudication tasks


