AI Safety Experts – English, Punjabi
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI red-team contractor probing conversational models for Mercor, which partners with AI labs to train frontier systems. Testing jailbreaks, vulnerabilities, and harmful-content risks.
Responsibilities:
- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Follow taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements:
- Native fluency in English and Punjabi is required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor status
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits:
- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity project participation is optional
- Clear content guidelines and wellness resources
- Competitive pay
- Reasonable accommodations upon request
- Referral payments of up to $90 per successful referral (referral limits apply)
Similar Jobs
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI systems for Mercor and its AI-lab partners. Identifying vulnerabilities through adversarial prompts and safety evaluations.
AI Safety Expert – English, Telugu
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Finding vulnerabilities and producing reproducible safety data.
AI Safety Experts, English, Punjabi
AI red-team expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.
AI Safety Expert – English, Gujarati
AI safety red teamer probing conversational AI models for Mercor, which partners with leading AI labs and enterprises. Generating vulnerability data, attack cases, and reproducible safety evaluations.
AI Safety Expert, English, Gujarati
AI red team expert probing Mercor-partnered frontier AI models for vulnerabilities. Generating annotated datasets, attack cases, and reproducible safety reports in English and Gujarati.
AI Safety Specialist
AI safety specialist supporting Mercor’s short-term AI safety project. Applying red-teaming and related domain expertise during a fast-paced remote sprint.
AI Safety Expert – English, Marathi
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs and enterprises to train frontier systems. Generating reproducible vulnerability data and attack cases.
AI Safety Expert – English, Tamil
AI safety red teamer probing conversational AI models for Mercor, which partners with leading labs to train frontier systems. Generating vulnerability data and reproducible attack artifacts.
AI Safety Expert, English, Punjabi
AI red-teaming experts probing conversational models for Mercor’s frontier AI safety projects. Generating vulnerability data, attack cases, and reproducible reports for AI labs and enterprises.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment, robustness, and safety through adversarial evaluation.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment, robustness, and safety.
Senior/Staff AI Model Engineer
AI model engineer owning evaluation, safety, and reliability for Clear Street’s AI copilot. Improving model quality across trading workflows on a cloud-native brokerage platform.
Trainer for CAD and Artificial Intelligence in Engineering
CAD- und KI-Trainer:in für eine Qualifizierung zur modernen digitalen Produktentwicklung. Vermittlung von Generative Design, KI-gestützten CAD-Workflows und technischer Bewertung.
Trainer – CAD, Artificial Intelligence & Engineering
Trainer:in für CAD und KI im Engineering bei einem digitalen Weiterbildungsanbieter. Vermittlung praxisnaher KI-gestützter Konstruktions- und CAD-Workflows an Maschinenbau-Fachkräfte.
Senior Director Analyst – AI Technology Economics
Senior Gartner analyst shaping AI economics research across technology markets. Developing thought leadership and advising executives through data-driven economic insights.
AI Safety Expert – English, Kannada
AI Safety Experts red-teaming conversational models for Mercor, which partners with AI labs to train frontier systems. Probing vulnerabilities and producing reproducible safety data.
AI Safety Expert – English, Kannada
AI safety red teamer probing conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Creating vulnerability data, attack cases, and reproducible reports.
AI Safety Expert – English, Marathi
AI safety red-teamer probing Mercor’s frontier AI models with adversarial English and Marathi inputs. Generating vulnerability annotations, attack cases, datasets, and reproducible reports.
AI Safety Red Teamer
AI Safety Red Teamer designing adversarial prompts and uncovering vulnerabilities in Mercor’s frontier AI projects. Evaluating model behavior across high-risk domains and supporting AI safety research.
Staff AI Builder
Staff AI Builder designing and shipping production GenAI systems for Robots and Pencils’ enterprise clients. Leading agentic AI, RAG, AWS architecture, reliability, and technical mentoring.