AI Safety Expert, English, Assamese
Posted 1ds ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety red teamer probing Mercor customer AI models for vulnerabilities. Generating adversarial data, reproducible attack cases, and safety insights.
Responsibilities:
- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements:
- Fluent/native fluency in English and Assamese
- Strong judgment about language and content, including evaluating whether AI responses are accurate, complete, and appropriate
- Ability to explain reasoning clearly to technical and non-technical audiences
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H-1B or STEM OPT candidate
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits:
- Fully remote role completed on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Competitive pay
- Collaboration with leading researchers
- Referral opportunity earning up to $90 per successful referral, with no limit on referrals (restrictions may apply)


