AI Safety Expert – English, Odia
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety expert red-teaming Mercor’s frontier AI models through adversarial testing and human-data generation. Evaluating vulnerabilities in English and Odia across flexible, fully remote contract projects.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases customers can act on
- Review AI outputs involving sensitive topics such as bias, misinformation, and harmful behaviors
- Uncover vulnerabilities that automated tests miss
- Expand evaluation coverage and reduce production surprises
- Strengthen customer AI systems and support safer, more trustworthy AI
- Collaborate with leading researchers on projects training and enhancing frontier AI systems
Requirements:
- Native fluency in English and Odia is required
- Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Ability to adapt across projects, task types, and customers
- Applicants must not require H1-B or STEM OPT support
- Independent contractor status
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, and model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, and reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, and conversational AI testing
- Nice-to-have: psychology, acting, or writing experience for unconventional adversarial thinking
Benefits:
- Fully remote role that can be completed on your own schedule
- Participation in higher-sensitivity projects is optional
- Clear guidelines and wellness resources for sensitive-content projects
- Weekly payments via Stripe or Wise based on services rendered
- Competitive pay
- Reasonable accommodations upon request
- Referral payments of up to $90 for each successful referral, subject to limits
- Opportunity to collaborate with leading researchers
- Opportunity to build experience in human data-driven AI red teaming
- Independent contractor engagement
Similar Jobs
Senior AI Agent Engineer
Senior AI Agent Engineer building Rumor Avenue's new AI product from scratch. Developing Python/FastAPI backend, React interfaces, and production LLM features.
AI Safety Expert, English – Kannada
AI safety red-teaming specialist probing frontier models for Mercor. Generating adversarial test data, vulnerability analyses, and reproducible attack artifacts for AI labs and enterprises.
AI Safety Expert, English, Punjabi
AI safety red teamer probing Mercor-trained AI models through adversarial English and Punjabi testing. Generating vulnerability annotations, attack cases, datasets, and reproducible reports.
AI Safety Experts – English, Telugu
AI red-teaming contractor probing Mercor’s frontier models with adversarial inputs. Generating human-labeled safety data, vulnerability reports, datasets, and attack cases.
AI Safety Expert – English, Punjabi
AI red-teaming expert probing Mercor customer models with English and Punjabi adversarial inputs. Annotating vulnerabilities and producing reproducible safety datasets and attack reports.
AI Workforce Planning Consultant
Consultoría de planificación laboral con IA para rediseñar organizaciones en Ethikos. Análisis de roles, capacidades y tareas para transformar el trabajo futuro.
External Research Collaborator, Formal Mathematics – AI
External Research Collaborator building AI pipelines that convert mathematics into verified Lean 4 code. Supporting RWS’s mission to unlock global understanding through language and content technology.
AI Enablement Facilitator
AI Enablement Facilitator helping Scale Army, an international staffing agency, sell and deliver AI implementation pods to U.S.-based companies. Facilitating executive workshops, live AI builds, and roadmap closes.
AI Enablement Engineer
AI Enablement Engineer building secure production AI tools, agents, and workflows for Revalize’s manufacturing technology platform. Integrating LLM systems with Salesforce, Microsoft 365, and enterprise workflows.
Business Applications & AI Technical Consultant
Remote technical consultant delivering Microsoft Dynamics 365, Power Platform, Fabric, Azure, and AI solutions. Traveling nationally to customer locations as project needs require.
AI Innovation Associate
AI Innovation Associate building LLM, agentic AI and machine-learning solutions for Aculocity’s global industrial businesses. Working remotely on real enterprise data and business challenges.
AI Safety Expert – English, Telugu
AI safety red teamer probing conversational models for Mercor’s human-data AI training projects. Generating reproducible vulnerability data to strengthen frontier AI systems.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance AI systems. Identifying jailbreaks, safety failures, and vulnerabilities.
AI Safety Expert – English, Assamese
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial data, vulnerability classifications, and reproducible attack artifacts.
AI Safety Expert, English, Odia
AI safety red teamers probing conversational AI models for vulnerabilities. Generating human data and reproducible attack artifacts for Mercor’s AI lab and enterprise customers.
Accounting, Data, and Artificial Intelligence Internship
Estagiário de Contabilidade preparando dados financeiros para IA e automação. Instituto Infnet, faculdade brasileira focada em tecnologia, dados, comunicação e design.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor. Designing adversarial prompts and evaluating high-risk model behavior.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment through adversarial evaluation.
AI Safety Expert, English – Bengali
AI red-teaming experts probing conversational models for Mercor, which helps AI labs train frontier systems. Testing vulnerabilities and producing reproducible safety data in English and Bengali.
AI Safety Experts – English, Odia
AI safety expert red-teaming conversational AI models for Mercor’s frontier-model training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.