Study Domain Expert – Judge Calibration – Sales
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Sales expert evaluating and scoring AI-generated work for Mercor, which partners with leading AI labs and enterprises to train frontier models. Providing evidence-based feedback in a remote study.
Responsibilities:
- Apply professional judgment to realistic Sales work and evaluate model-generated outputs
- Complete one realistic Sales task using supplied source files
- Review model outputs, rank and score them, and write evidence-based rationales
- Provide structured feedback on the task and study design
- Participate in a 13-hour study during September 12–15, 2026
Requirements:
- More than 5 years of experience in Sales or a closely relevant field
- Ideally held a manager, director, or principal-level Sales role; entry-level experience alone is insufficient
- Fluent or native English
- Prior work as an expert is a plus
- Sign an NDA before receiving study materials
- No use of LLMs or other AI assistants during the study
- People who have worked on Project Alchemy in any capacity or accessed its source-world data are not eligible
- Unable to support H1-B or STEM OPT candidates at this time
- Must work as an independent contractor
Benefits:
- Payments are weekly on Stripe or Wise based on services rendered
- Fully remote role that can be completed on your own schedule
- Competitive pay
- Collaborate with leading researchers
- Help shape the next generation of AI systems
Similar Jobs
Real Estate Sales Agent
Agent commercial indépendant développant le portefeuille de locations courte durée d’ALB Conciergerie. Prospection de propriétaires, signature de mandats et coordination opérationnelle sur son secteur.
Area Sales Manager – Central Germany
Area Sales Manager für Bauzulieferprodukte bei PohlCon, einem deutschen Bauzulieferer. Neukundengewinnung, Kundenbetreuung und Vertriebsentwicklung in Hannover/Braunschweig.
Sales Representative – Opener – Cold Caller
Opener/Cold Caller für ExpertenAnglers Social-Recruiting-Beratung. Telefonische B2B-Neukundengewinnung und Terminierung für technische Fachbetriebe und Ingenieurbüros.
Closer de Ventas
Closer de ventas para los programas online de coaching, fitness, nutrición y mindset de SARIADNA. Realización de videollamadas con leads cualificados y cierre de ventas de alto valor.
Sales Agent
Remote life insurance sales agent selling requested coverage to families. Receiving training, mentor support, uncapped commissions, and milestone-based incentives.
Sales Agent
Remote life insurance sales agent serving families who requested coverage help. Selling policies through training and mentor-supported conversations with uncapped commissions.
Sales Agent
Remote life insurance sales agent serving families seeking coverage. Starting without experience through training, mentorship, and uncapped commission earnings.
Sales Agent
Remote life insurance sales agent serving families who requested coverage help. Training, mentorship, and uncapped commissions offered with no experience required.
Sales Agent
Remote life insurance sales agent serving families seeking coverage. Closing inbound sales with training, mentorship, and uncapped commission earnings.
Sales Agent
Remote life insurance Sales Agent serving families who requested coverage information. Selling policies with training, mentorship, and uncapped commission potential.
Sales Agent
Remote life insurance sales agent serving families who requested coverage help. Training, mentorship, and uncapped commissions available without prior sales experience.
Entry-Level Sales Representative, Warm Leads
Remote entry-level sales representative helping U.S. families choose life insurance through Meron Financial Agency’s warm-lead system. Handling client calls, policy matching, and commission-based sales.
Entry Level Sales
Remote life insurance agent helping families choose coverage through Meron Financial Agency’s 60+ carrier network. Handling inbound leads, client calls, and policy recommendations.
Entry Level Sales
Remote life insurance sales agent helping U.S. families choose coverage through 60+ carrier partners. Working inbound leads with structured training, mentorship, and uncapped commission.
Sales Agent
Agente de Vendas remoto promovendo produtos e soluções da PIETRA BARIVIERA. Prospecção outbound, negociação e relacionamento com clientes em modelo PJ comissionado.
Sales Executive, IT Solutions
Sales Executive selling enterprise IT solutions to banks, governments, telecoms, and corporates. Managing enterprise accounts, proposals, pipelines, and full-cycle deal closures.
Asesor de Ventas
Asesor remoto de ventas de portabilidad para Claro, atendiendo Lima y Callao. Sueldo fijo, comisiones ilimitadas, bono de internet y planilla completa.
Senior Sales Director – Mobility, Industrial, and Advanced Technology
Senior Sales Director growing OEM accounts across mobility, industrial, and advanced technology markets. Driving demand, forecasting, contracts, and programs for USA Rare Earth's critical-minerals supply chain.
Asesor de ventas público peruano
Asesor de ventas remoto para Konecta, conectando una compañía telefónica con clientes peruanos. Gestionando contacto, asesoría y cierre de ventas desde Trujillo.
Asesor de Ventas Movistar Prepago – Comisiones SIN TOPE, bonos, Capacitaciones Pagadas
Asesor remoto de ventas telefónicas para captar clientes de otros operadores y gestionar su portabilidad a Movistar México. Trabajo desde casa con comisiones y bonos.