AI Safety Expert – English, Punjabi
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial datasets, vulnerability reports, and attack cases.
Responsibilities:
- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Probe vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements:
- Native fluency in English and Punjabi required
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must not require H1-B or STEM OPT support
- Nice-to-have specialty in adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits:
- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Competitive pay
- Wellness resources and clear guidelines for higher-sensitivity projects
- Reasonable accommodations upon request
- Referral opportunity earning up to $90 per successful referral
Similar Jobs
AI Safety Expert – English, Kannada
AI safety red-team expert probing frontier AI models for Mercor. Testing vulnerabilities, generating human data, and producing reproducible safety artifacts for AI labs and enterprises.
AI Safety Expert, English – Danish
AI red-teaming expert probing Mercor clients’ frontier AI models for jailbreaks, bias, and misuse. Generating reproducible safety data, attack cases, and vulnerability reports.
AI Safety Expert – English, Punjabi
AI red-teaming contractor probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data, attack cases, and safety insights.
Workflow & AI Agent Engineer
Workflow and AI Agent Engineer supporting clients of Chatarmin’s B2B WhatsApp marketing SaaS. Owning onboarding, support, API-driven solutions, and product feedback loops.
AI Safety Expert – English, Telugu
AI safety red-teamer probing conversational models for Mercor. Generating adversarial datasets and reproducible vulnerability reports to help AI labs and enterprises build safer systems.
AI Systems Innovation Consultant
AI Systems Innovation Consultant für Aivisorys KI-Beratung. Entwicklung und Umsetzung von KI-Strategien, Workshops und Lösungen für Kunden.
Co-Founder, Tech Partner – AI, Open Source
Technical co-founder designing open-source AI and data infrastructure for ESG, governance, and process intelligence. Building architecture, integrations, and LLM-powered applications within Estonia’s startup ecosystem.
Working Student – AI Sales
Werkstudent im B2B-Vertrieb für eine Berliner KI-Agenten- und Sprachautomatisierungsplattform. Generierung und Qualifizierung von Leads durch Cold Calling, E-Mail-Outreach und Terminvereinbarung.
AI Voice Evaluation Specialist
AI voice evaluator comparing two conversational AI models for Innodata, a global data engineering company. Recording interactions, assessing quality, categorizing errors, and documenting model preferences.
AI Safety Expert – English, Gujarati
AI red-teaming contractor probing conversational models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.
AI Safety Expert – English, Telugu
AI red-teaming experts probing Mercor’s frontier AI systems in English and Telugu. Testing conversational models for vulnerabilities and producing actionable safety data.
AI Safety Expert – English, Tamil
AI red-teaming contractor probing Mercor customer models for jailbreaks, bias, and misuse. Generating reproducible safety data for frontier AI labs and enterprises.
AI Safety Expert – English, Assamese
AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.
AI Safety Expert – English, Gujarati
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial data, vulnerability reports, and reproducible attack cases.
AI Safety Expert, English, Gujarati
AI red-teaming expert probing Mercor customer models for jailbreaks, bias, and misuse. Generating reproducible human-data artifacts that improve frontier AI safety.
AI Safety Expert – English, Tamil
AI safety red teamer probing conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible reports.
AI Safety Experts, English – Marathi
AI red-teaming experts testing Mercor’s frontier models through adversarial English and Marathi analysis. Probing vulnerabilities and producing datasets that make customer AI systems safer.
AI Safety Expert – English, Bengali
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data and reproducible attack cases.
AI Safety Expert – English, Urdu
AI safety red teamer probing Mercor-partnered frontier AI models for vulnerabilities. Testing conversational systems and generating actionable human data in English and Urdu.
AI Safety Expert – English, Bengali
AI safety red teamer probing frontier AI models for Mercor, which partners with leading labs and enterprises to train models. Generating vulnerability data and reproducible attack artifacts.