Deep Research Reviewer

Posted 16hrs ago

Employment Information

Industry
Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Welo Data freelance reviewer evaluating AI-generated consumer research. Checking citations, scoring rubric criteria, and writing evidence-based rationales.

Responsibilities:

  • Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
  • Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
  • Write short, specific rationales (1-3 sentences) that point to concrete evidence
  • Follow guideline updates and calibrate decisions consistently with the QA team

Requirements:

  • Native or near-native US English (C2), with the ability to read long documents containing tables and citations
  • Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
  • Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
  • Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
  • Ability to write concise rationales that cite evidence
  • Ability to judge each criterion independently, without letting an overall impression influence the call
  • Reliable availability of 15-20 hours per week
  • Stable internet connection
  • Laptop or desktop computer

Benefits:

  • Reliable availability of 15-20 hours per week
  • Stable internet connection and a laptop or desktop computer