AI Safety Experts, English, Kannada

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs. Generating human data and reproducible vulnerability reports.

Responsibilities:

  • Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases
  • Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
  • Expand evaluation coverage and uncover vulnerabilities automated tests miss
  • Create artifacts that strengthen customers’ AI systems

Requirements:

  • Native fluency in English and Kannada
  • Strong judgment about language and content, including evaluating whether AI responses are accurate, complete, and appropriate
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Rigorous attention to subtle errors, inconsistencies, and gaps
  • Ability to consistently follow guidelines and quality standards
  • Adaptability across projects, task types, and customers
  • Independent contractor status
  • Must not be an H1-B or STEM OPT candidate
  • Nice-to-have specialties include adversarial ML, cybersecurity, socio-technical risk, or creative probing

Benefits:

  • Fully remote role
  • Flexible schedule; work can be completed on your own schedule
  • Weekly payments via Stripe or Wise
  • Projects may be extended, shortened, or concluded early depending on needs and performance
  • Opportunity to build experience in human data-driven AI red teaming
  • Direct role in making AI systems more robust, safe, and trustworthy
  • Collaborate with leading researchers
  • Referral payments of up to $90 for each successful referral, with no limit on referrals (restrictions may apply)
  • Reasonable accommodations upon request