AI Safety Experts – English, Telugu

Posted 3hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI safety red-teamer probing conversational models for Mercor’s human-data AI training projects. Generating vulnerability datasets, attack cases, and reproducible reports to strengthen frontier AI systems.

Responsibilities:

  • Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
  • Produce reproducible reports, datasets, and attack cases for customers
  • Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
  • Uncover vulnerabilities automated tests miss
  • Expand evaluation coverage and reduce production surprises
  • Strengthen customer AI systems through adversarial testing

Requirements:

  • Native fluency in English and Telugu
  • Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Rigorous attention to subtle errors, inconsistencies, and gaps
  • Ability to consistently follow guidelines and quality standards
  • Adaptability across projects, task types, and customers
  • Independent contractor engagement
  • Must not be an H1-B or STEM OPT candidate
  • Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
  • Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
  • Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
  • Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking

Benefits:

  • Fully remote role
  • Flexible schedule / work on your own schedule
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or concluded early depending on needs and performance
  • Higher-sensitivity project participation is optional
  • Clear guidelines and wellness resources for sensitive-content work
  • Competitive pay
  • Collaborate with leading researchers
  • Reasonable accommodations upon request
  • Referral payments of up to $90 per successful referral (referral limits apply)