AI Safety Expert – English, Tamil

Posted 2hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI safety red teamer probing conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible reports.

Responsibilities:

  • Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases for customers
  • Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
  • Uncover vulnerabilities automated tests miss
  • Expand evaluation coverage and reduce production surprises
  • Strengthen customer AI systems and support safer, more trustworthy AI

Requirements:

  • Native fluency in English and Tamil is required
  • Strong judgment about language and content
  • Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
  • Rigorous attention to subtle errors, inconsistencies, and gaps
  • Ability to consistently follow guidelines and quality standards
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Adaptability across projects, task types, and customers
  • Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
  • Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
  • Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
  • Nice-to-have: creative probing experience in psychology, acting, or writing
  • Must be engaged as an independent contractor
  • H1-B or STEM OPT candidates are not supported

Benefits:

  • Fully remote role
  • Flexible schedule / work on your own schedule
  • Weekly payments via Stripe or Wise
  • Competitive pay
  • Opportunity to build experience in human data-driven AI red teaming at the frontier of safety
  • Direct role in making AI systems more robust, safe, and trustworthy
  • Higher-sensitivity projects are optional
  • Clear guidelines and wellness resources for sensitive-content projects
  • Reasonable accommodations upon request
  • Referral opportunity paying up to $90 per successful referral (referral limits apply)