Business Domain Expert – AI Model Evaluation Pilot, Admin, Marketing, HR, Accounting
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Business domain experts completing professional tasks and evaluating frontier AI outputs for Mercor. Providing ranked, scored, evidence-based feedback across HR or Accounting.
Responsibilities:
- Complete one realistic, domain-specific task using provided source files
- Review five model-generated attempts for the task
- Rank the attempts from 1–5 without ties
- Score each attempt from 0–100
- Write evidence-based rationales citing specific parts of each output
- Provide structured feedback on the task and study design
- Sign an NDA before receiving study materials
- Participate in a one-time, short structured AI model evaluation pilot estimated at 8–12 hours
Requirements:
- 5+ years of hands-on professional experience in Human Resources or Accounting
- Currently or recently practicing in the relevant domain
- Ability to write clear, specific, evidence-grounded rationales
- Reliability within a short turnaround window
- Must sign an NDA before receiving materials
- Must not have worked on Project Alchemy in any capacity or accessed its source world data
- Use of LLMs or other AI assistants is prohibited at every stage
- Must be able to work as an independent contractor
- H1-B and STEM OPT candidates are not supported
Benefits:
- Fully remote role with flexible self-scheduled work
- Weekly payments via Stripe or Wise
- Competitive pay
- Opportunity to collaborate with leading researchers
- Opportunity to help shape the next generation of AI systems
- Referral program paying up to $400 per successful referral, with no limit on referrals (restrictions may apply)
- Reasonable accommodations upon request
Similar Jobs
Accounting Manager
Accounting Manager leading North American manufacturing accounting operations, controls, reporting, and audits. Supporting VistaPrint’s design, digital, and print solutions for small businesses.
Senior Accountant, Accounting Operations
Senior Accountant managing operating expenses for Prefect’s Python orchestration and MCP platforms. Owning AP, T&E, budgeting, month-end close, and accounting process automation.
Accounting Manager
Finance Manager leading FP&A, reporting, and accounting for Oak Hill Bio, a rare disease therapeutics company. Supporting US and UK entities, GAAP compliance, close processes, and financial insight.
Accounting Manager
Accounting Manager supporting FP&A, accounting, and reporting for Oak Hill Bio, a rare-disease therapeutics company. Managing US/UK close processes, GAAP compliance, and financial analysis.
Accounting Manager
Financial Reporting Manager overseeing GAAP financial statements, audits, and international entity reporting. Establishing accounting policies, internal controls, and variance analysis processes.
Accounting Manager
Financial Reporting Manager overseeing GAAP financial statements, audits, and international entity reporting. Leading controls, variance analysis, and accounting policy implementation for a distributed company.
Accounting Manager
Accounting Manager owning multi-entity reporting, close, controls, and crypto transaction accounting at Quidax. Supporting audits, compliance, forecasting, and CFO decision-making as African fintech scales.
Tax Accounting Intern, Summer 2027
Tax Accounting Intern supporting federal, state, and local tax compliance at QC Servion, a data center services operations hub. Preparing workpapers, analyzing tax data, and researching tax matters.
Staff Accounting Intern – Summer 2027
Accounting intern supporting payroll, reconciliations, reporting, budgeting, and month-end close. QC Servion provides centralized operational services across data-center industry companies.
Project Accounting, Billing Intern
Project Accounting & Billing Intern supporting invoicing, project data, and financial reporting. QC Servion provides operational services across data center industry companies.
Senior Accounting Manager
Senior Accounting Manager owning GAAP close, consolidation, technical accounting, and finance systems. Scaling accounting operations for Firework’s AI-powered video-commerce platform.
Accounting Lead – CPA
Accounting Lead managing close, reporting, and scalable finance processes for Bask Health’s telehealth infrastructure. Supporting SaaS revenue recognition, compliance, automation, and high-volume transactions.
Investor Accounting Analyst
Investor Accounting Analyst reconciling mortgage-servicing accounts and remittance data. Supporting Carrington Mortgage Services’ integrated lending and loan-servicing operations.
Manager, Accounting – Revenue Cycle Management
Accounting manager overseeing revenue-cycle accounting, financial reporting, controls, and audits. Supporting NextGen Healthcare’s technology platform for ambulatory practices.
Manager, Accounting Services Operations
Accounting operations manager scaling Dine Technology’s outsourced accounting services for restaurant operators. Leading U.S. and offshore teams, process improvement, automation, profitability, and scalable service delivery.
Accounting Manager
Senior Accountant managing payroll, reconciliations, and close activities for CAC, a Christian contemplative nonprofit. Improving scalable finance operations in a fully remote role.
Accounting Clerk, Digital Back Office, Tax Clerk
Buchhaltungssachbearbeiter/in für das digitale Backoffice eines deutschen Beratungsunternehmens. Betreuung von Kundenbuchhaltungen, Meldungen und Abschlussvorbereitungen vollständig remote.
Junior Accounting Specialist
Junior Accounting Specialist für Finanzbuchhaltung und Abschlüsse bei mittelständischem Unternehmen in Bielefeld. Steuerliche Meldungen, Kontenabstimmungen und Prozessoptimierung im Rechnungswesen.
Accounting Expert
Accounting Expert evaluating AI-generated and human accounting work for a client project. Creating rubrics and reviewing deliverables against US GAAP and professional standards.
Accounting Manager
Accounting Manager leading client accounting pods for Zenbooks, a Canadian remote accounting firm. Owning reporting quality, client relationships, team development, pod metrics, and revenue performance.