AI Safety Experts, English, Punjabi
Posted 9hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI red-team expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Annotate failures, classify vulnerabilities, and flag systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Probe AI systems to uncover vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through human data-driven red teaming
Requirements:
- Fluent/native fluency in English and Punjabi required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Rigorous attention to subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must not require H1-B or STEM OPT support
- Nice-to-have specialties: adversarial ML, jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction, penetration testing, exploit development, reverse engineering, harassment/disinformation probing, abuse analysis, conversational AI testing, psychology, acting, and writing
Benefits:
- Fully remote role
- Work on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Wellness resources and clear guidelines for higher-sensitivity projects
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Competitive pay
- Collaboration with leading researchers






