Part-Time Legal AI Reviewer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Legal AI reviewer evaluating and improving AI-generated legal responses for Aston Carter, a corporate talent solutions provider. Designing expert training tasks, rubrics, and model feedback.
Responsibilities:
- Review and evaluate AI-generated responses to legal prompts for accuracy, clarity, and professional appropriateness
- Annotate and rank model outputs to guide AI training and improvement
- Write expert-level answers to legal questions as model training examples
- Flag errors, misconceptions, or ambiguous outputs and provide corrective guidance
- Design and build realistic legal tasks from professional experience, including scenarios, prompts, supporting input files, and grading rubrics
- Run tasks against AI models and iterate based on expert reviewer feedback
- Follow detailed written instructions and document/upload format requirements
- Maintain consistent quality and throughput throughout the sprint engagement
Requirements:
- Demonstrated legal experience (litigation, corporate/transactional, compliance, or similar); does not need to be a currently practicing attorney
- Strong written communication skills; ability to explain complex concepts clearly and concisely
- Currently or recently performing this work at a detailed, individual-contributor level, not solely in a managerial capacity
- Careful reading of written instructions; receptive to feedback and revision cycles
- Baseline tech literacy, including cloud file tools such as Google Workspace, browser profiles, desktop app installation, and everyday file handling
- Comfortable working independently in a remote, self-directed environment
- Based in the United States
- Available for 30–40 hours per week for the full 12-week engagement
- General understanding of LLM use and the AI landscape
- J.D. and bar admission are not required; preferred
Benefits:
- Medical, dental & vision
- Critical Illness, Accident, and Hospital
- 401(k) Retirement Plan – Pre-tax and Roth post-tax contributions available
- Life Insurance (Voluntary Life & AD&D for the employee and dependents)
- Short and long-term disability
- Health Spending Account (HSA)
- Transportation benefits
- Employee Assistance Program
- Time Off/Leave (PTO, Vacation or Sick Leave)
Similar Jobs
Associate Attorney
Associate Attorney managing commercial litigation matters across Texas for Rastegar, a real estate investment firm. Drafting filings, supporting hearings, and coordinating with internal and outside counsel.
Associate Attorney
Associate Attorney litigating debt-collection matters for a Nebraska creditor's rights law firm. Managing caseloads, court proceedings, pleadings, motions, and legal-risk analysis remotely.
Associate Attorney
Associate Attorney litigating debt collection matters for a creditor’s rights law firm. Managing caseloads, court proceedings, pleadings, and legal risk analysis remotely.
Attorney-Represented Bodily Injury Adjuster
Attorney-represented bodily injury adjuster handling complex auto claims for National General insurance. Investigating liability, coverage, damages, and negotiating injury settlements.
Legal & Compliance Manager
Legal & Compliance Manager building legal infrastructure for NATURTREU, a German dietary-supplement brand. Managing legal advice, compliance, contracts, risk monitoring, and external counsel.
Solicitor – Specialist Liability, Data
Solicitor defending data breach and cyber-attack claims for DAC Beachcroft’s insurer and corporate clients. Managing complex civil litigation, client advice and trial preparation.
Legal, Commercial Expert
Legal/commercial expert reviewing domain documents for Mercor’s AI training projects. Providing structured feedback on quality, accuracy, and relevance.
Legal, Grants, ESG Experts
Legal, grants, and ESG experts reviewing domain-specific documents for Mercor. Providing structured feedback to help train and enhance frontier AI systems.
Legal Intake Receptionist
Legal Intake Receptionist serving as the first contact for family-law inquiries through calls, emails, CRM records, and referrals. Remote role supporting US-based employers through Job Duck.
Senior Trial Attorney
Senior Trial Attorney defending Allstate insureds in Massachusetts bodily injury, property damage, and PIP litigation. Managing complex cases, trials, mediations, and strategic claims counsel remotely.
Legal Intern
Legal Intern supporting insurance, claims, underwriting, employment, and compliance matters. CNO Financial Group provides insurance and financial services to middle-income America.
Managing Attorney
Managing Attorney leading workers’ compensation defense, litigation, and attorney development. Fully remote role with women-owned California law firm.
Associate Attorney
Associate Attorney litigating consumer-credit cases for PRA Group, a global debt-recovery company. Preparing pleadings, managing discovery, and representing the company in Texas proceedings.
Legal Subject Matter Expert – UAE
UAE Legal SME analyzing commercial law and compliance matters for TransPerfect’s language and technology solutions. Annotating legal datasets and validating AI-generated legal responses.
Legal Subject Matter Expert, Philippines
Legal SME helping DataForce by TransPerfect train legal AI using Philippine-law research, annotation, and validation. Auditing AI outputs for accurate citations, interpretation, and reasoning.
Legal Subject Matter Expert – China
Legal SME helping DataForce train legal AI through Chinese patent analysis, claims drafting, and CNIPA expertise. Validating datasets and auditing AI-generated legal reasoning.
Legal Subject Matter Expert, United Kingdom
UK Legal SME applying commercial and regulatory expertise to annotate legal data and evaluate AI responses. Supporting accurate legal reasoning in TransPerfect’s AI systems.
Legal Subject Matter Expert – EU
Legal SME applying EU AI Act and GDPR expertise to train and validate legal AI systems. Supporting structured regulatory reasoning and privacy-focused prompt engineering.
Legal Subject Matter Expert – Germany, Switzerland
Legal SME annotating German-language legal data and validating AI reasoning for Germany and Switzerland. Applying corporate, labour, administrative, and regulatory expertise for TransPerfect’s language technology solutions.
Legal Subject Matter Expert, Brazil
Brazilian legal SME researching corporate and commercial law, annotating Portuguese legal datasets, and validating AI outputs. Supporting TransPerfect’s language and technology solutions for global business.