Professional Services Practice Reviewer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Professional services practitioners auditing AI-generated work products for Mercor, which trains frontier AI models with human expertise. Reviewing realism, accuracy, grading, and practitioner usability.
Responsibilities:
- Audit AI agents’ work products in the reviewer’s professional field
- Evaluate whether tasks are realistic and relevant to the job
- Check domain content, standards, figures, regulations and constraints for accuracy and consistency
- Review graders’ yes/no assessments of finished work and explain disagreements
- Independently band the work and assess whether a practitioner could use or accept it
- Compare the reviewer’s band with the reported score
- Review approximately one item per hour without performing or redoing the underlying task
- Provide written reasoning for each judgment
Requirements:
- 5+ years running real project plans, schedules and budgets (Project Management Specialists)
- PMP a plus
- US-qualified and actively practicing lawyer with 4+ years post-admission, drafting own documents
- 4+ years owning a close, audit file or set of financial statements (Accountants and Auditors)
- CPA or CA strongly preferred
- 3+ years shipping production code maintained by other engineers (Software Developers)
- 4+ years owning an IT function, its budget and vendors (Computer and Information Systems Managers)
- Professional experience producing and reviewing relevant work artifacts
- Near-native business English
- Comfort using spreadsheets or PDFs to verify numerical reconciliation
- Independent contractor engagement
- Must not require H-1B or STEM OPT support
Benefits:
- Fully remote role
- Flexible own schedule
- Weekly payments via Stripe or Wise
- Opportunity to collaborate with leading researchers
- Work on projects training and enhancing AI systems
- Referral earnings of up to $350 per successful referral
Similar Jobs
Reviewer, Biology
VCE Biology Reviewer improving accurate, engaging, syllabus-aligned lessons for Atomi’s edtech platform. Editing scripts and quizzes while supporting educational content creators.
Quality Reviewer, College Football
College football QA reviewer checking image and video annotations for CloudFactory’s AI data services. Identifying errors and providing actionable correction feedback remotely.
Technical Reviewer
Technical Reviewer validating audit and inspection reports for QIMA, a global testing, inspection, certification, and compliance company. Reviewing corrective actions and ensuring accurate, timely delivery.
Clip Picker, Video Reviewer
Clip picker and video reviewer identifying high-performing short-form moments from Johnny Chang’s biblical content. Reviewing edits, tagging clips, and optimizing selections through performance data.
Video Reviewer
Video Reviewer examining online footage for illegal school-bus passes at BusPatrol, an AI-powered school-bus safety technology company. Determining violations accurately while meeting review-volume metrics.
Appraisal Reviewer
Appraisal Reviewer assessing nationwide 1–4 family residential valuations for Planet Capital. Reviewing collateral risk, value support, vendor reports, and regulatory compliance.
Maps Personalization Quality Reviewer, Japanese
Quality Reviewer responsible for auditing rater evaluations for maps/search personalization. Ensuring accuracy and compliance with established guidelines.
Maps Personalization Quality Reviewer, French
Quality Reviewer auditing personalization features in maps/search experience and ensuring compliance with formatting and guideline requirements. Reviewing rater work for logical alignment and accuracy in outputs.
RN Utilization Management Care Reviewer
Remote RN Utilization Management Care Reviewer at Banner Health determining medical appropriateness of services. Collaborating with care teams to optimize member outcomes and support safe transitions.
RN MDS Reviewer
RN MDS Reviewer supporting successful MDS completion and submission to MassHealth. Collaborating with clinical staff and providing training for Care Management team.
Quality Reviewer, Years 7-12 Mathematics
Mathematics Quality Reviewer ensuring the quality of Years 7-12 mathematics lessons for Education Perfect, an EdTech platform. Collaborating with teams to enhance educational content quality in a remote setting.
Oasis Reviewer
OASIS Reviewer at Synergy supporting Home Health agencies with compliance and data integrity. Collaborating with clinical teams for accurate OASIS assessments and documentation.
Business General Question Reviewer, Years 11-12
QCAA Certified Teacher role supporting validation of QCAA Business Question sets and providing feedback on educational content. Ideal for candidates with QCAA teaching experience and tech-savvy skills.
Behavioral Health Utilization Management Reviewer
Behavioral Health Utilization Management Reviewer managing care coordination and medical necessity for behavioral health services while collaborating with providers. Ensuring quality and compliance in a fast-paced environment.
DRG Reviewer
DRG Reviewer conducting reviews of inpatient claims to ensure coding accuracy at MedReview. A fully remote position requiring coding certification and 3+ years of experience.
Data Reviewer – Small Molecule
Data Reviewer performing complex analytical analysis on pharmaceutical and biopharmaceutical compounds. Ensuring compliance with SOPs and GMP in a fully remote capacity supporting a GMP Laboratory.
Oasis Reviewer
OASIS Reviewer ensuring compliance and data integrity for Home Health documentation. Collaborating with clinicians and reviewing assessments for accuracy and completeness.
No more related jobs available.