AI Safety Red Teamer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance them. Identifying vulnerabilities across high-risk domains.
Responsibilities:
- Design adversarial prompts to stress-test frontier AI models
- Identify jailbreaks, unsafe behaviours, hallucinations, and policy failures
- Evaluate model robustness across misinformation, cyber, biosecurity, fraud, political content, and other sensitive domains
- Document vulnerabilities and contribute to safety benchmarking and red-teaming reports
- Collaborate with AI researchers to improve model alignment, robustness, and safety
- Work on projects focused on training and enhancing AI systems
Requirements:
- Bachelor's degree or higher in Computer Science, Cybersecurity, Journalism, Communications, Psychology, Biology, Chemistry, Public Policy, or a related discipline
- 5+ years of professional experience in AI Safety, AI Red Teaming, Trust & Safety, cybersecurity, investigative journalism, life sciences, or a related field
- Strong analytical reasoning, prompt design, and written communication skills
- Experience designing adversarial prompts or evaluating frontier AI systems
- Preferred: experience with AI Red Teaming, RLHF, SFT, AI Alignment, or Trust & Safety
- Preferred: familiarity with jailbreak testing, prompt engineering, or adversarial evaluation methodologies
- Preferred: expertise in one or more grey-area domains, including cyber, biosecurity, political content, misinformation, or scientific safety
- Must be able to work as an independent contractor
- H1-B and STEM OPT candidates are not supported
Benefits:
- Fully remote role
- Flexible schedule; work can be completed on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Opportunity to work on cutting-edge adversarial testing alongside leading AI researchers and safety teams
- Opportunity to influence how AI systems respond to complex, real-world safety challenges
- Competitive pay
- Referral bonus of up to $340 per successful referral
Similar Jobs
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train frontier systems. Identifying vulnerabilities and improving model safety through adversarial testing.
AI Strategy – Digital Implementation
Werkstudent:in entwickelt Website, App und Praxis-Dashboard für MedTech-Startup Xeno Patch. Einsatz von KI-Tools und Nutzerfeedback zur schnellen Produktverbesserung.
AI Safety Expert, English – Odia
AI red teaming expert probing Mercor-trained frontier models for jailbreaks, bias, and misuse. Generating reproducible safety data and vulnerability reports for AI labs and enterprise customers.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated responses for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated content for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
Software, AI, IT, Data Evaluator
AI Evaluator reviewing documents, spreadsheets, and slide decks for accuracy and domain quality. Helping Mercor’s AI lab partners train and enhance frontier models.
Director, Information Technology – Enterprise AI
Director leading IT, cybersecurity, and enterprise AI strategy for Vehlo, an auto repair technology and financial solutions provider. Governing security, AI platforms, infrastructure, and technology operations.
Senior Director Analyst – Integration and APIs, AI
Senior Gartner analyst shaping AI-era integration and API research. Advising enterprise leaders on MCP, AI gateways, and integration strategy.
Senior Director, Analyst – Tech CEO Business and Strategy Advisor on AI Orchestration
Senior Gartner analyst advising Texas-based technology CEOs on AI Orchestration growth, market dynamics, and innovation. Creating research, frameworks, forecasts, and presentations for Gartner clients and events.
Senior Director, Analyst – Healthcare Providers, RCM & Healthcare AI Technology
Senior Director shaping Gartner insights on healthcare providers' U.S. revenue cycle management, coding, and AI technologies. Advising executives and clients through research, presentations, and strategic guidance.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance AI systems. Identifying vulnerabilities and improving model safety.
Bilingual Dutch STEM Expert – AI Safety
PhD STEM expert evaluating Dutch-language scientific AI responses for Mercor. Writing specialist prompts and annotating model safety, accuracy, and helpfulness.
Bilingual Portuguese Generalist Expert – AI Safety
Bilingual Portuguese Generalist evaluating sensitive-topic AI model safety for Mercor. Writing prompts, classifying conversations, and flagging adversarial patterns.
Bilingual Danish STEM Expert – AI Safety
Bilingual Danish PhD STEM expert writing prompts and evaluating scientific responses. Improving AI safety for Mercor’s frontier-model training projects.
Bilingual German Generalist Expert – AI Safety
Bilingual German Generalist evaluating sensitive-topic AI behavior for Mercor’s frontier-model training projects. Writing German prompts, classifying conversations, and flagging adversarial patterns.
Bilingual Korean Generalist Expert – AI Safety
Bilingual Korean Generalist Expert evaluating sensitive-topic handling in Korean for Mercor’s frontier AI training projects. Writing prompts, classifying conversations, and flagging adversarial patterns.
Bilingual Danish Generalist Expert – AI Safety
Bilingual Danish Generalist Expert evaluating sensitive AI-model behavior for Mercor. Writing prompts, classifying conversations, and flagging adversarial patterns in frontier-model training projects.
Bilingual Russian Generalist Expert – AI Safety
Bilingual Russian Generalist evaluating sensitive-topic prompts and conversations for Mercor. Applying language expertise to train safer frontier AI models.
Bilingual Croatian STEM Expert – AI Safety
Bilingual Croatian PhD scientist evaluating scientific AI responses and writing safety prompts. Supporting Mercor’s frontier-model training through expert technical annotation.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI models for Mercor’s AI lab partnerships. Designing adversarial prompts and evaluating high-risk model behavior.