RN Clinical Data Annotation Specialist

Posted 3hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

RN reviewing and annotating AI clinical-agent interactions for Hippocratic AI’s safety-focused healthcare LLM. Assessing accuracy, safety, and guideline adherence.

Responsibilities:

  • Review recorded and simulated AI agent interactions across primary care, chronic disease management, care management, medication adherence, and scheduling
  • Assess agent responses for clinical accuracy, safety, and appropriateness
  • Score and annotate agent performance using structured evaluation rubrics aligned with evidence-based protocols and clinical practice guidelines
  • Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning
  • Provide clear, actionable written feedback to clinical and product teams
  • Participate in periodic calibration sessions to ensure consistent annotation standards

Requirements:

  • Active, unrestricted RN license in the United States; compact license preferred
  • Minimum 5 years of hands-on clinical experience
  • Strong clinical judgment and working knowledge of evidence-based protocols and clinical practice guidelines
  • Comfortable reviewing written transcripts and applying structured rubrics with a high level of attention to detail
  • Strong written communication skills for documenting feedback and corrections clearly
  • Able to work independently and meet turnaround expectations
  • Prior experience in clinical quality assurance, utilization review, or case review recommended
  • Experience with chart audits or clinical documentation review recommended
  • Familiarity with AI-assisted clinical tools or digital health platforms recommended
  • Legally authorized to work in the United States
  • Registered Nurse or Nurse Practitioner license must be active and unrestricted in the United States

Benefits:

  • Flexible scheduling
  • Fully remote work arrangement
  • Opportunity to work with a healthcare-only, safety-focused LLM platform
  • Participation in periodic calibration sessions with other clinical reviewers
  • Flexible part-time availability considered (20–40 hours/week)