Physician, Medical AI Evaluation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
US-licensed physicians evaluating clinical EHR vignettes and reasoning quality. Mindrift uses expert reviews to test and improve medical AI systems.
Responsibilities:
- Evaluate clinical EHR vignettes paired with questions, proposed answers, and distractor answers across diagnosis and treatment tasks
- Score clinical reasoning quality, vignette accuracy and completeness, answer correctness and gradeability, and trap quality
- Check whether reasoning chains reach answers from vignette facts alone
- Correct reasoning traces and write short rationales
- Participate in three independent blind reads and physician adjudication
- Complete qualification(s), join the project, submit tasks through the platform, and receive payment for approved tasks
Requirements:
- Medical degree (MD or DO)
- Active, unrestricted US medical license, verified at onboarding and re-checked monthly
- Board certification or completed residency training
- Direct patient care experience; attending-level preferred
- Broad, multi-system diagnostic and treatment experience in internal, family, emergency, or hospital medicine
- Strong clinical reasoning, including differential diagnosis, next-step management, and application of evidence-based guidelines
- Strong written English (C1+)
- US-licensed physician status
- Must not be a medical student, unlicensed medical graduate, non-physician clinician, or non-clinical healthcare professional
- Prior medical AI evaluation, clinical content or exam-question review, or medical annotation/QA experience is a plus
Benefits:
- Earnings per approved task: a fixed rate for each task, set in advance
- Fully self-scheduled: no minimum hours and no set schedule
- Remote work
- No patient contact and no malpractice exposure
- $50 one-time onboarding reward, paid once the first task on the project is approved
- Quality incentives: additional earnings for high-quality approved tasks
- Flexible participation around other commitments
- No time tracking or hour logging
Similar Jobs
Physician, Medical AI Evaluation
US-licensed physicians evaluating clinical EHR cases for Mindrift’s medical AI projects. Flexible task-based work assessing diagnoses, treatments, and clinical reasoning.
Physician Reviewer, MD/DO – Medical AI Evaluation
US-licensed physicians evaluating EHR vignettes, clinical reasoning, and treatment answers for Mindrift’s medical AI projects. Flexible, task-based remote contractor work.
Physician Reviewer, MD/DO – Medical AI Evaluation
US-licensed physicians evaluating EHR clinical cases for Mindrift’s medical AI projects. Scoring diagnostic reasoning, answers, and distractors on a flexible task-based schedule.
AI Solutions Specialist
Remote legal assistant coordinating high-net-worth client matters for a US-based law firm. Managing client communication, calendars, drafting, document workflows, and matter progression.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating EHR clinical cases for Mindrift’s AI improvement projects. Flexible, task-based freelance work with no patient contact.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating clinical EHR vignettes for Mindrift’s medical AI projects. Reviewing reasoning, answers, and treatment decisions in flexible freelance tasks.
Licensed Physician, Freelance AI Trainer
Freelance MDs/DOs reviewing clinical EHR vignettes and reasoning for Mindrift’s medical AI projects. Flexible, task-based remote work with per-task payment.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating EHR clinical cases for Mindrift’s medical AI projects. Reviewing diagnoses, treatment reasoning, answers, and distractors.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating EHR clinical cases for Mindrift’s medical AI projects. Flexible, task-based freelance work with no patient contact.
Licensed Physician, Freelance AI Trainer
Freelance MDs/DOs evaluating clinical EHR vignettes for Mindrift’s AI improvement projects. Flexible, task-based remote work with no patient contact.
Licensed Physician, Freelance AI Trainer
Freelance MD/DO evaluating EHR clinical vignettes and reasoning for Mindrift’s medical AI projects. Flexible, task-based remote work with no patient contact.
Licensed Physician, Freelance AI Trainer
Freelance US-licensed physicians evaluating clinical EHR cases for Mindrift’s medical AI projects. Scoring diagnostic reasoning, answers, and distractors through flexible task-based work.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating clinical EHR vignettes and reasoning quality for Mindrift’s medical AI projects. Flexible, task-based freelance work with no set schedule or minimum hours.
Licensed Physician, Freelance AI Trainer
Freelance US-licensed physicians evaluating clinical EHR cases and reasoning for Mindrift’s AI improvement projects. Flexible, task-based independent contractor work with no patient contact.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating EHR clinical cases for Mindrift’s medical AI projects. Flexible, task-based freelance work with no minimum hours or set schedule.
Licensed Physician, Freelance AI Trainer
Freelance US-licensed physician evaluating EHR vignettes and clinical reasoning for Mindrift’s medical AI projects. Flexible, task-based remote work with no minimum hours.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating clinical EHR cases and reasoning for Mindrift’s medical AI projects. Flexible, task-based freelance work with no patient contact.
Licensed Physician, Freelance AI Trainer
US-licensed physicians evaluating clinical EHR cases for Mindrift’s medical AI projects. Flexible, task-based freelance work improving diagnosis and treatment reasoning.
Licensed Physician, Freelance AI Trainer
Freelance physicians evaluating clinical EHR vignettes for Mindrift’s medical AI projects. Reviewing diagnoses, treatments, reasoning quality, and benchmark answers.
Licensed Physician – Freelance AI Trainer
US-licensed physicians evaluating EHR vignettes and clinical reasoning for Mindrift’s medical AI projects. Flexible, task-based freelance work with no patient contact.