RN Clinical Data Annotation Specialist
Posted 3hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
RN reviewing and annotating AI clinical-agent interactions for Hippocratic AI’s safety-focused healthcare LLM. Assessing accuracy, safety, and guideline adherence.
Responsibilities:
- Review recorded and simulated AI agent interactions across primary care, chronic disease management, care management, medication adherence, and scheduling
- Assess agent responses for clinical accuracy, safety, and appropriateness
- Score and annotate agent performance using structured evaluation rubrics aligned with evidence-based protocols and clinical practice guidelines
- Identify clinical safety concerns, inappropriate recommendations, edge cases, and gaps in agent clinical reasoning
- Provide clear, actionable written feedback to clinical and product teams
- Participate in periodic calibration sessions to ensure consistent annotation standards
Requirements:
- Active, unrestricted RN license in the United States; compact license preferred
- Minimum 5 years of hands-on clinical experience
- Strong clinical judgment and working knowledge of evidence-based protocols and clinical practice guidelines
- Comfortable reviewing written transcripts and applying structured rubrics with a high level of attention to detail
- Strong written communication skills for documenting feedback and corrections clearly
- Able to work independently and meet turnaround expectations
- Prior experience in clinical quality assurance, utilization review, or case review recommended
- Experience with chart audits or clinical documentation review recommended
- Familiarity with AI-assisted clinical tools or digital health platforms recommended
- Legally authorized to work in the United States
- Registered Nurse or Nurse Practitioner license must be active and unrestricted in the United States
Benefits:
- Flexible scheduling
- Fully remote work arrangement
- Opportunity to work with a healthcare-only, safety-focused LLM platform
- Participation in periodic calibration sessions with other clinical reviewers
- Flexible part-time availability considered (20–40 hours/week)









