AI Safety Expert – English, Bengali
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety red-teamer probing conversational models for Mercor’s human-data AI training projects. Generating vulnerability data, attack cases, and reproducible reports.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Help Mercor customers strengthen the safety, robustness, and trustworthiness of AI systems
Requirements:
- Fluent/native fluency in English and Bengali
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not require H1-B or STEM OPT support
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits:
- Fully remote role
- Flexible own schedule
- Weekly payments via Stripe or Wise
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content work
- Competitive pay
- Collaboration with leading researchers
- Referral payments of up to $90 per successful referral
Similar Jobs
AI Safety Expert – English, Telugu
AI safety red teamer probing conversational models for Mercor’s human-data AI training projects. Generating reproducible vulnerability data to strengthen frontier AI systems.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance AI systems. Identifying jailbreaks, safety failures, and vulnerabilities.
AI Safety Expert – English, Assamese
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial data, vulnerability classifications, and reproducible attack artifacts.
AI Safety Expert, English, Odia
AI safety red teamers probing conversational AI models for vulnerabilities. Generating human data and reproducible attack artifacts for Mercor’s AI lab and enterprise customers.
Accounting, Data, and Artificial Intelligence Internship
Estagiário de Contabilidade preparando dados financeiros para IA e automação. Instituto Infnet, faculdade brasileira focada em tecnologia, dados, comunicação e design.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor. Designing adversarial prompts and evaluating high-risk model behavior.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment through adversarial evaluation.
AI Safety Expert, English – Bengali
AI red-teaming experts probing conversational models for Mercor, which helps AI labs train frontier systems. Testing vulnerabilities and producing reproducible safety data in English and Bengali.
AI Safety Experts – English, Odia
AI safety expert red-teaming conversational AI models for Mercor’s frontier-model training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment, robustness, and safety through adversarial evaluation.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI models for Mercor’s AI training projects. Designing adversarial prompts and evaluating high-risk AI behavior.
AI Safety Expert, English – Kannada
AI red team expert probing Mercor’s frontier models for vulnerabilities using adversarial English and Kannada inputs. Generating reproducible safety data, reports, and attack cases for AI customers.
AI Safety Expert – English, Punjabi
AI red-teaming contractor probing conversational models for Mercor’s human-data AI safety projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.
AI Safety Expert – English, Tamil
AI red-team expert probing conversational models for Mercor’s human-powered frontier AI training. Testing vulnerabilities, annotating failures, and producing reproducible safety datasets.
AI Safety Expert – English, Tamil
AI red-team contractor probing conversational models for Mercor, which helps AI labs and enterprises train frontier systems. Testing jailbreaks, vulnerabilities, and harmful behaviors through structured human data.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment, robustness, and safety through adversarial evaluation.
AI Safety Expert, English – Tamil
AI red-teaming experts probing conversational models for Mercor, which partners with AI labs to train frontier systems. Testing vulnerabilities and generating actionable human safety data.
AI Safety Expert – English, Gujarati
AI red team expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial datasets, vulnerability reports, and attack cases.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing Mercor's frontier AI models. Identifying vulnerabilities across high-risk domains and improving model alignment, robustness, and safety.
AI Safety Expert, English, Telugu
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.