AI Safety Expert, English & Assamese
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI red teaming experts probing conversational models for Mercor, which partners with AI labs and enterprises to train frontier systems. Generating vulnerability data and reproducible attack artifacts.
Responsibilities:
- Red team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Identify vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems through adversarial testing
Requirements:
- Fluent/native English and Assamese required
- Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing
- Ability to probe AI systems adversarially and push systems to breaking points
- Experience using frameworks or benchmarks for structured testing
- Ability to explain risks clearly to technical and non-technical stakeholders
- Ability to adapt across projects and customers
- Independent contractor status
- Unable to support H1-B or STEM OPT candidates
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: creative probing experience in psychology, acting, or writing
Benefits:
- Flexible schedule; work can be completed on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Fully remote work
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Collaboration with leading researchers
- Competitive payment
- Higher-sensitivity project participation is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Referral payments of up to $90 per successful referral
Similar Jobs
AI Automation, Integration Specialist
AI automation specialist scaling Primal Storm’s natural-products eCommerce operations. Building Python and API workflows to reduce repetitive work across the company.
Generative AI Analyst
Generative AI Analyst reviewing and annotating Polish content for Welo Data, a global AI data company. Improving datasets and quality processes for multilingual generative AI systems.
AI Safety Expert, English – Dutch
AI safety red teamer probing conversational AI models for Mercor’s human-data AI training projects. Testing vulnerabilities, generating reproducible datasets, and strengthening frontier AI systems.
Marketing Expert – Paid Growth, AI Agent Environments
Paid Growth expert designing and evaluating simulated acquisition tasks for Mercor’s AI training environments. Diagnosing campaigns, budgets, funnels, and journeys using Google Ads, Meta Ads, and GA4 expertise.
AI Safety Expert, English – Dutch
AI safety red team experts probing Mercor-trained frontier AI models for vulnerabilities. Testing conversational agents and producing reproducible datasets, reports, and attack cases.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs and enterprises. Identifying vulnerabilities and improving model safety through adversarial evaluation.
Senior Design Expert – Paid AI Design Research Study
Senior designers shaping AI design tooling through recorded research sessions for Mercor. Evaluating design quality, critique, and shipping standards while helping train AI systems.
AI Safety Expert, English, Finnish
AI red-teaming experts probing frontier models for Mercor’s human-data AI training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in Mercor’s frontier AI projects. Designing adversarial prompts and evaluating model safety across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train frontier systems. Identifying vulnerabilities and improving model safety through adversarial testing.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance them. Identifying vulnerabilities across high-risk domains.
AI Strategy – Digital Implementation
Werkstudent:in entwickelt Website, App und Praxis-Dashboard für MedTech-Startup Xeno Patch. Einsatz von KI-Tools und Nutzerfeedback zur schnellen Produktverbesserung.
AI Safety Expert, English – Odia
AI red teaming expert probing Mercor-trained frontier models for jailbreaks, bias, and misuse. Generating reproducible safety data and vulnerability reports for AI labs and enterprise customers.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated responses for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated content for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
Software, AI, IT, Data Evaluator
AI Evaluator reviewing documents, spreadsheets, and slide decks for accuracy and domain quality. Helping Mercor’s AI lab partners train and enhance frontier models.
Director, Information Technology – Enterprise AI
Director leading IT, cybersecurity, and enterprise AI strategy for Vehlo, an auto repair technology and financial solutions provider. Governing security, AI platforms, infrastructure, and technology operations.
Senior Director Analyst – Integration and APIs, AI
Senior Gartner analyst shaping AI-era integration and API research. Advising enterprise leaders on MCP, AI gateways, and integration strategy.
Senior Director, Analyst – Tech CEO Business and Strategy Advisor on AI Orchestration
Senior Gartner analyst advising Texas-based technology CEOs on AI Orchestration growth, market dynamics, and innovation. Creating research, frameworks, forecasts, and presentations for Gartner clients and events.
Senior Director, Analyst – Healthcare Providers, RCM & Healthcare AI Technology
Senior Director shaping Gartner insights on healthcare providers' U.S. revenue cycle management, coding, and AI technologies. Advising executives and clients through research, presentations, and strategic guidance.