AI Safety Experts – English, Bengali
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety red team expert probing Mercor’s partner AI models for vulnerabilities. Generating reproducible adversarial data, reports, and attack cases to improve model safety.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements:
- Native fluency in English and Bengali required
- Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing
- Ability to probe systems adversarially and push them to breaking points
- Experience using frameworks, taxonomies, benchmarks, or playbooks
- Ability to explain risks clearly to technical and non-technical stakeholders
- Ability to adapt across projects and customers
- Independent contractor engagement
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have specialties: adversarial ML, cybersecurity, socio-technical risk, creative probing
- Adversarial ML experience with jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction is a plus
- Cybersecurity experience with penetration testing, exploit development, or reverse engineering is a plus
- Socio-technical experience with harassment/disinformation probing, abuse analysis, or conversational AI testing is a plus
- Creative probing experience in psychology, acting, or writing is a plus
Benefits:
- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content work
- Competitive pay
- Collaboration with leading researchers
- Referral opportunity earning up to $90 per successful referral
Similar Jobs
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI models for Mercor’s AI lab partnerships. Designing adversarial prompts and evaluating high-risk model behavior.
AI Safety Expert – English, Portuguese
AI safety red teamer probing conversational models for jailbreaks, prompt injections, and systemic risks. Producing human-data artifacts that help Mercor customers build safer frontier AI.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor’s AI training partnerships. Identifying vulnerabilities and improving model alignment, robustness, and safety.
Principal AI Search – Conversation Architect
Principal AI architect building conversational search and commerce orchestration for OleOle’s global football super app. Designing LLM, agent, retrieval, and recommendation systems across real-time sports services.
AI Workflow Engineer
AI workflow engineer building Python and GenAI automation for BlueCross BlueShield of Tennessee. Supporting Treasury and Internal Audit workflow modernization, governance, training, and adoption.
AI Prompt Engineer
Prompt Systems Engineer designing and evaluating AI agents for Noodle, a higher-education strategy, services, and technology partner. Improving enrollment, learning, and student-support experiences.
Senior AI, Product Enablement Specialist
Senior AI and Product Enablement Specialist creating technical labs and training. Enabling customers on Sysdig’s cloud-native security solutions across containers, Kubernetes, Linux, and public cloud.
Senior AI & Product Enablement Specialist
Senior AI and Product Enablement Specialist building technical labs and training for Sysdig’s cloud security platform. Automating Kubernetes, Linux, and public-cloud learning environments.
AI Automation Lead
AI automation lead building workflows, CRM systems, and internal tools for Nucleus Network’s advisory, venture, and events businesses. Improving relationship data, efficiency, and scalable operations.
Engineer I, AI Agents
Engineer I building AI agent platforms for AARP, the nonprofit empowering older Americans. Developing LLM integrations, workflows, and enterprise solutions.
AI Leadership Industry Expert – University, Academic Experience
AI Leadership Facilitator delivering postgraduate AI Leadership education for peopleworth. Leading live sessions, mentoring learners, and supervising academic facilitators remotely.
AI Builder Grant
AI Builder Grant providing Claude access to university students in Austria, Germany, and Switzerland. Supporting personal AI projects and exposure to real-world artificial intelligence tooling.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing Mercor’s partner frontier AI models. Identifying jailbreaks, hallucinations, and policy failures across high-risk domains.
Trainer for CAD and Artificial Intelligence in Engineering
CAD- und KI-Trainer:in für digitale Produktentwicklung im Maschinenbau. Vermittlung generativer Design- und Engineering-Workflows an Fachkräfte.
CAD and Artificial Intelligence Trainer – Engineering
CAD- und KI-Trainer:in für die Weiterbildung von Maschinenbau-Fachkräften. Vermittlung generativer Design- und KI-gestützter Engineering-Workflows für die digitale Produktentwicklung.
Data Management & AI Analyst, Healthcare
Data-Analyst-Weiterbildung für Klinik-, Pflege- und Verwaltungsdaten bei DataSmart Point. Lernen von SQL, Power BI, Python und Predictive Analytics für digitale Gesundheitsprojekte.
AI Safety Expert – English, Assamese
AI safety red-teamer probing conversational models for Mercor’s frontier AI projects. Generating adversarial datasets, vulnerability reports, and attack cases to strengthen AI systems.
Marketing Expert – Marketing Analytics, AI Agent Environments
Marketing analytics expert designing realistic task environments for Mercor’s AI-agent training projects. Evaluating data diagnosis, attribution, reporting, and multi-tool decision-making.
AI Safety Expert – English, Danish
AI safety red teamer probing frontier AI models for Mercor. Testing jailbreaks, vulnerabilities, and harmful behaviors to generate safer human-data-driven AI systems.
Management Consultant – AI Strategy Evaluation
Management Consultant evaluating AI-generated strategy responses for Gramian Consultancy. Creating consulting prompts, reference answers, and feedback to improve model reasoning.