Deep Research Reviewer, English (US)
Posted 18hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Welo Data freelancer reviewing AI-generated research on US consumer topics. Evaluating citations, claims, tables, and rubric criteria to improve AI research quality.
Responsibilities:
- Review long form research responses covering US consumer topics such as personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
- Evaluate each response against rubric criteria, scoring every criterion independently so that an overall impression doesn't sway individual judgments
- Check claims, tables, and citations for accuracy, and distinguish primary sources from low-quality or content-farm pages
- Write short, specific rationales (1-3 sentences) that point to concrete evidence
- Follow guideline updates and calibrate your decisions consistently with the QA team
Requirements:
- Native or near-native US English (C2), with the ability to read long documents containing tables and citations
- Familiarity with US consumer topics: personal finance and taxes, healthcare and insurance, home repair, pets, and travel planning
- Bachelor's degree, or equivalent experience in research, editing, fact-checking, teaching, or QA
- Proven experience with rubric- or guideline based evaluation (e.g., AI/LLM rating, search quality rating, content moderation, grading, or editorial QA)
- Ability to write concise rationales that cite evidence
- Ability to judge each criterion independently, without letting an overall impression influence the call
- Reliable availability of 15-20 hours per week, with a stable internet connection and a laptop or desktop computer

















