AI Safety Expert, English, Gujarati

Posted 16hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI red team expert probing Mercor-partnered frontier AI models for vulnerabilities. Generating annotated datasets, attack cases, and reproducible safety reports in English and Gujarati.

Responsibilities:

  • Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases
  • Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
  • Uncover vulnerabilities that automated tests miss
  • Expand evaluation coverage and reduce production surprises
  • Strengthen customer AI systems through adversarial testing

Requirements:

  • Native fluency in English and Gujarati
  • Strong judgment about language and content
  • Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
  • Attention to subtle errors, inconsistencies, and gaps
  • Ability to follow taxonomies, benchmarks, playbooks, guidelines, and quality standards consistently
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Adaptability across projects, task types, and customers
  • Nice-to-have expertise in adversarial ML, cybersecurity, socio-technical risk, or creative probing
  • Must be engaged as an independent contractor
  • H1-B and STEM OPT candidates are not supported

Benefits:

  • Fully remote role
  • Flexible schedule / work on your own schedule
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or concluded early depending on needs and performance
  • Participation in higher-sensitivity projects is optional
  • Clear guidelines and wellness resources for sensitive-content work
  • Reasonable accommodations upon request
  • Opportunity to build experience in human data-driven AI red teaming
  • Collaborate with leading researchers
  • Referral payments of up to $90 for each successful referral, subject to limits