AI Safety Expert – English, Assamese

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.

Responsibilities:

  • Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases
  • Probe AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
  • Uncover vulnerabilities that automated tests miss
  • Expand evaluation coverage and reduce production surprises
  • Strengthen customer AI systems through adversarial testing

Requirements:

  • Native fluency in English and Assamese
  • Strong judgment about language and content
  • Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
  • Ability to notice subtle errors, inconsistencies, and gaps
  • Ability to consistently follow guidelines and quality standards
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Adaptability across projects, task types, and customers
  • Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, or creative probing
  • Must be engaged as an independent contractor
  • H1-B and STEM OPT candidates are not supported

Benefits:

  • Fully remote role
  • Flexible schedule; work on your own schedule
  • Weekly payments via Stripe or Wise
  • Wellness resources and clear guidelines for higher-sensitivity projects
  • Competitive pay
  • Opportunity to collaborate with leading researchers
  • Referral payments of up to $90 per successful referral