AI Safety Expert – English, Telugu

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI safety red teamer probing conversational models for Mercor’s human-data AI training projects. Generating reproducible vulnerability data to strengthen frontier AI systems.

Responsibilities:

  • Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases for customers
  • Probe AI outputs involving bias, misinformation, and harmful behaviors
  • Uncover vulnerabilities automated tests miss
  • Expand evaluation coverage and reduce surprises in production
  • Strengthen customer AI systems through adversarial testing

Requirements:

  • Fluent/native fluency in English and Telugu required
  • Strong judgment about language and content, including assessing whether AI responses are accurate, complete, and appropriate
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Rigorous attention to subtle errors, inconsistencies, and gaps
  • Ability to consistently follow guidelines and quality standards
  • Adaptability across projects, task types, and customers
  • Independent contractor status
  • Must not be an H1-B or STEM OPT candidate
  • Nice-to-have specialties include adversarial ML, cybersecurity, socio-technical risk, creative probing, penetration testing, exploit development, reverse engineering, jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction, harassment/disinformation probing, abuse analysis, conversational AI testing, psychology, acting, or writing

Benefits:

  • Fully remote role that can be completed on your own schedule
  • Weekly payments via Stripe or Wise based on services rendered
  • Projects may be extended, shortened, or concluded early depending on needs and performance
  • Participation in higher-sensitivity projects is optional
  • Clear content guidelines and wellness resources for higher-sensitivity projects
  • Reasonable accommodations upon request
  • Opportunity to build experience in human data-driven AI red teaming
  • Opportunity to collaborate with leading researchers
  • Referral payments of up to $90 for each successful referral