Legal Expert – AI Training, Evaluation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Legal expert designing and judging complex legal tasks for Weekday’s YC-backed AI recruiting and data platform. Evaluating model accuracy across research, contracts, compliance, and legal reasoning.
Responsibilities:
- Design complex legal problems, including research questions, contract analyses, and compliance scenarios, with clear, defensible model answers
- Review AI-generated legal responses line by line and grade accuracy, reasoning, and completeness
- Identify hallucinated case law, misread clauses, missed exceptions, and flawed reasoning
- Write clear rationales for evaluations so the model and team learn from them
- Work across legal research, contract analysis, regulatory compliance, and legal reasoning
- Submit work that meets quality and rigour standards; every task is reviewed
Requirements:
- 3+ years of relevant legal experience—in practice, in-house, or at a firm
- Strong legal research and analytical skills
- Ability to trace questions to the right authority and explain why it applies
- Comfort with contracts, compliance, and reasoning across more than one area of law
- Precision in writing
- Low tolerance for plausible-sounding nonsense
- Reliability on deadlines
- Curiosity about how AI is going to change legal work
- Practising lawyer or legal professional experience
Benefits:
- ₹20,000–25,000 per task
- Remote, flexible work that can fit around a practice or full-time role
- Flexible, task-based hours with no fixed working days
- Front-row seat to how frontier AI models are trained and evaluated on legal work
- Opportunity to help improve frontier AI models
- YC-backed team environment
- More tasks and larger projects if work is consistently strong
Similar Jobs
PLD/FT, Anti-Fraud, Compliance, Risk and Legal Coordinator
Coordenador de PLD, antifraude e compliance na WEpayments, empresa de pagamentos. Liderança de equipes, monitoramento transacional, prevenção a fraudes e suporte regulatório e jurídico.
Bankruptcy & Reorganization Attorney
Bankruptcy attorney advising Axiom’s global legal-services clients on Chapter 11, restructuring, and insolvency matters. Drafting transaction documents and guiding distressed businesses, creditors, and lenders.
Freelance Legal Interpreter – Immigration Proceedings
Freelance legal interpreter providing remote interpretation for U.S. immigration court hearings. Handling asylum, removal, bond, and related proceedings across multiple time zones.
Staff Attorney
Staff Attorney supporting Navitus, a pharmacy benefit manager making medications more affordable. Drafting contracts, researching law, and advising teams on regulatory and business matters.
Bilingual Immigration Staff Attorney, English-Spanish
Bilingual Immigration Staff Attorney handling complex cases for Mangone Law Firm, a New Jersey-based firm helping immigrants secure U.S. legal status. Representing clients and developing personalized immigration strategies.
Senior Legal Ops Specialist
Senior Legal Ops Specialist reviewing and coordinating US commercial contracts and waivers. Applying legal analysis, AI tools, and workflow operations to manage contract risk.
Criminal Defense Attorney – Temporary
Advogado criminalista temporário acompanhando procedimento perante o MPRJ. Avaliação de medidas disciplinares na OAB e responsabilidade civil para clientes no Rio de Janeiro.
Legal Intern
Legal Intern supporting Mercy For Animals’ animal-protection advocacy through legal research, memoranda, litigation, campaigns, and policy projects. Remote summer program with attorney supervision and nonprofit compliance work.
Associate Attorney, Workers' Compensation
Associate Attorney representing California workers in workers’ compensation matters at Abramson Labor Group. Managing cases, depositions, client negotiations, and resolutions remotely.
EEO Attorney – Final Agency Decision Writer
EEO attorney writing Final Agency Decisions for USDA civil rights complaints. Reviewing investigations, processing federal EEO cases, and drafting complex legal documents.
Lawyer, Forest Governance
Philippines-qualified lawyer advancing ClientEarth’s forest governance and biodiversity programme. Supporting legal research, stakeholder engagement, and policy strategy across the Philippines and Southeast Asia.
Legal Intern – Summer 2027
Legal Intern supporting Muon Space’s satellite lifecycle through compliance, contracts, and regulatory research. Gaining hands-on experience in commercial space law and government contracting.
Legal Contracts Administrator
Legal Contracts Administrator negotiating commercial agreements for Ferguson, a wholesale supplier serving plumbing, HVAC/R, waterworks, and industrial markets. Advising business leaders on contractual risk and compliance.
Legal Workflow Strategist
Legal Workflow Strategist embedding Octus’s credit intelligence and AI platform into leveraged finance and restructuring workflows. Translating legal client needs into scalable data-driven product solutions.
Pre-Litigation Attorney
Pre-litigation attorney supporting employee employment claims at a plaintiff-side law firm serving Minnesota and Illinois. Preparing demands, supporting negotiations, and managing delegated client matters.
Lawyer
Lawyers evaluating AI-generated legal work for Mercor, which partners with AI labs to train frontier models. Reviewing legal reasoning, drafting, precedent application, and litigation scenarios.
Attorney
Remote associate attorney supporting Albertelli Law’s Illinois real estate and creditors’ rights practice. Managing legal matters, court appearances, and lender representation.
EEO Adjudicator/Attorney
EEO attorney adjudicating USDA federal civil rights complaints for Intelligence Federal. Drafting Final Agency Decisions, reviewing investigations, and processing appeals remotely.
Part-Time Attorney
Part-time Arizona attorney reviewing and executing creditor-rights pleadings for HighPoint Law Offices. Fully remote role using CLS, Adobe PDF, and secure VPN systems.
Attorney
Alabama-licensed contract attorney reviewing and executing creditor-rights pleadings for HighPoint Law Offices. Remote legal-document work using CLS case management and Adobe PDF.