Text Situated Alignment Specialist – Contract

Posted 5hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

SME reviewing AI conversations for Careerflow Human Data Labs’ AI evaluation research. Identifying missing context and assessing recommendation quality across interpersonal scenarios.

Responsibilities:

  • Review AI conversations involving real-world interpersonal and everyday decision-making scenarios
  • Identify missing context and recommend relevant follow-up questions
  • Evaluate whether additional information would have changed AI recommendations
  • Distinguish critical ("load-bearing") information from non-essential information
  • Conduct qualitative reviews and document findings using structured evaluation guidelines
  • Collaborate with research teams to ensure consistent, high-quality assessments

Requirements:

  • 3–5 years of direct practice experience in the relevant professional field
  • Must be based in the USA, Canada or Western Europe
  • Social Work: MSW or equivalent graduate-level qualification in Social Work
  • Social Work: LCSW, LICSW, LMSW, or equivalent applicable social work license/credential
  • Experience with client assessment, case review, interviewing, counseling, or related social-work practice
  • Counseling/Therapy: MA/MS with LMFT, LPC, LCPC, or equivalent counseling/therapy license or credential
  • Psychology: PhD/PsyD in Clinical, Counseling, Social, or Industrial-Organizational Psychology
  • Experience with counseling, therapy, psychological assessment, interviewing, case review, or other relevant client-facing work
  • Qualitative Research, HCI, or Communication: MA/PhD or equivalent advanced expertise in HCI, Communication, Anthropology, Sociology, Qualitative Research, or a closely related discipline
  • Experience conducting qualitative research, interviews, user research, conversation analysis, thematic analysis, qualitative coding, or similar research activities
  • Mediation, Coaching, Student Services, Organizational Consulting, or related advisory fields: relevant professional qualification, credential, or demonstrated subject-matter expertise
  • Significant direct experience in advisory, client-facing, coaching, mediation, student advising/services, organizational consulting, or comparable work
  • Experience gathering context, understanding individual or organizational needs, and providing informed recommendations or guidance
  • Experience eliciting relevant context when clients initially provide incomplete information
  • Experience across relationships, work, education, family, planning, wellbeing, and resource constraints
  • Qualitative coding or structured case review experience
  • Ability to distinguish load-bearing context from descriptive/non-informative context
  • Experience reviewing interviews, consultations, coaching sessions, or client interactions to identify missed opportunities for clarification or information gathering
  • Must successfully pass the assessment
  • 4 hours PST overlap for 20- or 40-hour weekly schedules

Benefits:

  • Pay-per-task (PPT) compensation
  • Payment in USD
  • Fully remote work
  • Full-time or part-time engagement options
  • Short-term project engagement (3–6 weeks)