AI Safety Expert, English, Portuguese
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety experts red teaming conversational models for Mercor’s human-data AI projects. Probing vulnerabilities and generating reproducible datasets to improve frontier AI safety.
Responsibilities:
- Red team conversational AI models and agents
- Test jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to maintain consistent testing
- Produce reproducible reports, datasets, and attack cases for customers
- Probe sensitive topics including bias, misinformation, and harmful behaviors
- Help expand evaluation coverage and reduce production surprises
- Collaborate with leading researchers on projects training and enhancing AI systems
Requirements:
- Native fluency in English and Portuguese (global, excluding Brazilian Portuguese)
- Prior red teaming experience in AI adversarial work, cybersecurity, or socio-technical probing
- Ability to probe AI models using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Ability to annotate failures, classify vulnerabilities, and flag systemic risks
- Ability to follow taxonomies, benchmarks, and playbooks
- Ability to produce reproducible reports, datasets, and attack cases
- Ability to explain risks clearly to technical and non-technical stakeholders
- Adaptability across projects and customers
- H1-B and STEM OPT candidates are not supported
Benefits:
- Fully remote role
- Flexible, self-directed schedule
- Weekly payments via Stripe or Wise
- Higher-sensitivity project participation is optional
- Clear content guidelines and wellness resources
- Opportunity to build experience in human data-driven AI red teaming
- Direct role in making AI systems more robust, safe, and trustworthy
- Competitive pay
- Collaboration with leading researchers
- Referral payments of up to $180 per successful referral
Similar Jobs
AI Quality Evaluator, German
AI Quality Evaluator assessing German content, language quality, and cultural fit for Canva’s AI design experiences. Building datasets and refining labels with global localisation teams.
Software Evaluator – AI, IT, Data
Evaluator reviewing AI-generated software, IT, and data artifacts for Mercor. Grading quality, identifying errors, and providing structured feedback to train frontier AI systems.
AI Safety Expert, English & Danish
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs to train frontier systems. Generating reproducible vulnerability data and attack cases.
Senior Public Policy, Political Analysis Expert – AI Evaluation
Senior public policy expert creating regulatory and political-analysis tasks for Gramian Consultancy’s AI evaluation work. Reviewing AI outputs and translating complex evidence into actionable recommendations.
Working Student – AI Sales
Werkstudent im B2B-Vertrieb für autonome KI-Agenten und Sprachautomatisierung bei Lane One. Lead-Generierung, Cold Calling und Terminvereinbarung für das Sales-Team.
AI Automation Specialist – Part Time
AI automation specialist building agents and workflows for project management and commercial real estate. Integrating monday.com, SaaS tools, and AI solutions for teams across LATAM.
Master’s Scholarship Fellow – Applied AI and Automation Researcher
Pesquisador aplicado em IA e automação para a ICT Itaú, instituição brasileira de conexão entre indústria e conhecimento. Desenvolvendo automação, LLMs, artigos e patentes.
AI Systems Integration Specialist
AI integration specialist connecting Airtable, Google Workspace, Notion, and Claude. Optimizing automated workflows and data systems for Hireframe’s remote staffing operations.
Especialista en Inteligencia Artificial
Especialista en IA desarrollando soluciones generativas, LLMs y agentes inteligentes para clientes empresariales de Towa. Evaluación de tecnologías, arquitecturas, automatización e integración en proyectos de innovación.
Regional AI Business Lead
Regional AI sales leader driving complex enterprise AI infrastructure campaigns for Everpure, a data-storage company. Advising executive buyers, partners, and sales teams on scalable AI platforms and ROI.
Subject Matter Expert – AI Team Management
AI team-management course SME shaping Ziplines Education’s certificate content for working professionals. Recording practical lessons on AI adoption, supervision, team norms, and rollout planning.
Principal Enterprise AI and Transformation Architect
Principal architect delivering enterprise AI, automation, and systems integration for Simulations Plus, a drug-development software company. Building production solutions and guiding transformation across regulated enterprise operations.
Principal Technical Consultant – AI
Principal AI consultant delivering production GenAI and agentic workflows for AHEAD’s digital transformation platforms. Building, deploying, and operating reliable AI solutions for enterprise client engagements.
Senior Product Architect, K8s-Based AI Infrastructure
Product Architect designing Kubernetes-based AI infrastructure for NVIDIA’s accelerated computing platform. Shaping scalable architectures, prototypes, and AI solutions from concept through lifecycle.
AI Claims Reviewer – Dutch Language
Dutch AI Claims Reviewer fact-checking AI-generated claims for TrustScale, an AI trust and verification platform. Comparing claims with reliable sources and producing evidence-based verdicts.
Consultant – AI-Powered Insight, Quant / Advanced Analytics
Quantitative analytics consultant at Verve, helping global brands understand people, markets and opportunities. Applying research, advanced analytics and AI to solve complex client challenges.
Visiting Professor – Artificial Intelligence, Online
Visiting Professor teaching artificial intelligence at DeVry University. Developing course materials, facilitating learning, and integrating responsible AI into online instruction.
Principal, AI Solutions
Principal AI solutions leader designing AI agents, workflows, and automations for Higher Logic’s community solutions. Partnering with business teams to improve workflows, adoption, and measurable organizational outcomes.
AI & No-Code Mentor, Vibe Coding Bootcamp
AI- und No-Code-Mentor für Digitale Leute School, die Bootcamps für Product, Design und Tech anbietet. Begleitung von Quereinsteigern beim Bau digitaler Produkte mit AI- und No-Code-Tools.
AI Safety Practitioner
AI safety practitioner evaluating frontier models for Mercor, which partners with AI labs to train and enhance AI systems. Applying safety policies, identifying failures, and providing structured feedback on sensitive content.