AI Safety Expert, English – Bengali
Posted 15hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI red-teaming experts probing conversational models for Mercor, which helps AI labs train frontier systems. Testing vulnerabilities and producing reproducible safety data in English and Bengali.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Expand evaluation coverage and uncover vulnerabilities missed by automated tests
Requirements:
- Native fluency in English and Bengali
- Strong judgment about language and content, including assessing whether AI responses are accurate, complete, and appropriate
- Ability to identify subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not require H1-B or STEM OPT support
- Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits:
- Fully remote work
- Flexible own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content work
- Reasonable accommodations upon request
- Referral payments of up to $90 per successful referral


