AI Safety Experts, English, Kannada
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs. Generating human data and reproducible vulnerability reports.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Expand evaluation coverage and uncover vulnerabilities automated tests miss
- Create artifacts that strengthen customers’ AI systems
Requirements:
- Native fluency in English and Kannada
- Strong judgment about language and content, including evaluating whether AI responses are accurate, complete, and appropriate
- Ability to explain reasoning clearly to technical and non-technical audiences
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have specialties include adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits:
- Fully remote role
- Flexible schedule; work can be completed on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Collaborate with leading researchers
- Referral payments of up to $90 for each successful referral, with no limit on referrals (restrictions may apply)
- Reasonable accommodations upon request




