AI Safety Expert, English, Punjabi
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety red teamer probing Mercor-trained AI models through adversarial English and Punjabi testing. Generating vulnerability annotations, attack cases, datasets, and reproducible reports.
Responsibilities:
- Red-team conversational AI models and agents through jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Generate human data by annotating failures, classifying vulnerabilities, and flagging systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases for customers
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Identify vulnerabilities automated tests miss
- Expand evaluation coverage and reduce production surprises
- Collaborate with leading AI researchers on projects that train and enhance frontier AI systems
Requirements:
- Fluent/native fluency in English and Punjabi required
- Strong judgment about language and content; ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to consistently follow guidelines and quality standards
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must be able to work without access to confidential or proprietary information from another employer, client, or institution
- H1-B and STEM OPT candidates are not supported
- Nice-to-have: adversarial ML experience, including jailbreak datasets, prompt injection, RLHF/DPO attacks, or model extraction
- Nice-to-have: cybersecurity experience, including penetration testing, exploit development, or reverse engineering
- Nice-to-have: socio-technical risk experience, including harassment/disinformation probing, abuse analysis, or conversational AI testing
- Nice-to-have: creative probing experience in psychology, acting, or writing
Benefits:
- Fully remote role
- Flexible schedule / work on your own schedule
- Weekly payments via Stripe or Wise
- Projects may be extended, shortened, or concluded early depending on needs and performance
- Higher-sensitivity project participation is optional
- Clear content guidelines and wellness resources
- Reasonable accommodations upon request
- Competitive pay
- Referral earnings of up to $90 per successful referral (referral limits apply)
Similar Jobs
Senior AI Agent Engineer
Senior AI Agent Engineer building Rumor Avenue's new AI product from scratch. Developing Python/FastAPI backend, React interfaces, and production LLM features.
AI Safety Expert, English – Kannada
AI safety red-teaming specialist probing frontier models for Mercor. Generating adversarial test data, vulnerability analyses, and reproducible attack artifacts for AI labs and enterprises.
AI Safety Expert – English, Odia
AI safety expert red-teaming Mercor’s frontier AI models through adversarial testing and human-data generation. Evaluating vulnerabilities in English and Odia across flexible, fully remote contract projects.
AI Safety Experts – English, Telugu
AI red-teaming contractor probing Mercor’s frontier models with adversarial inputs. Generating human-labeled safety data, vulnerability reports, datasets, and attack cases.
AI Safety Expert – English, Punjabi
AI red-teaming expert probing Mercor customer models with English and Punjabi adversarial inputs. Annotating vulnerabilities and producing reproducible safety datasets and attack reports.
AI Workforce Planning Consultant
Consultoría de planificación laboral con IA para rediseñar organizaciones en Ethikos. Análisis de roles, capacidades y tareas para transformar el trabajo futuro.
External Research Collaborator, Formal Mathematics – AI
External Research Collaborator building AI pipelines that convert mathematics into verified Lean 4 code. Supporting RWS’s mission to unlock global understanding through language and content technology.
AI Enablement Facilitator
AI Enablement Facilitator helping Scale Army, an international staffing agency, sell and deliver AI implementation pods to U.S.-based companies. Facilitating executive workshops, live AI builds, and roadmap closes.
AI Enablement Engineer
AI Enablement Engineer building secure production AI tools, agents, and workflows for Revalize’s manufacturing technology platform. Integrating LLM systems with Salesforce, Microsoft 365, and enterprise workflows.
Business Applications & AI Technical Consultant
Remote technical consultant delivering Microsoft Dynamics 365, Power Platform, Fabric, Azure, and AI solutions. Traveling nationally to customer locations as project needs require.
AI Innovation Associate
AI Innovation Associate building LLM, agentic AI and machine-learning solutions for Aculocity’s global industrial businesses. Working remotely on real enterprise data and business challenges.
AI Safety Expert – English, Telugu
AI safety red teamer probing conversational models for Mercor’s human-data AI training projects. Generating reproducible vulnerability data to strengthen frontier AI systems.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance AI systems. Identifying jailbreaks, safety failures, and vulnerabilities.
AI Safety Expert – English, Assamese
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial data, vulnerability classifications, and reproducible attack artifacts.
AI Safety Expert, English, Odia
AI safety red teamers probing conversational AI models for vulnerabilities. Generating human data and reproducible attack artifacts for Mercor’s AI lab and enterprise customers.
Accounting, Data, and Artificial Intelligence Internship
Estagiário de Contabilidade preparando dados financeiros para IA e automação. Instituto Infnet, faculdade brasileira focada em tecnologia, dados, comunicação e design.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor. Designing adversarial prompts and evaluating high-risk model behavior.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying vulnerabilities and improving model alignment through adversarial evaluation.
AI Safety Expert, English – Bengali
AI red-teaming experts probing conversational models for Mercor, which helps AI labs train frontier systems. Testing vulnerabilities and producing reproducible safety data in English and Bengali.
AI Safety Experts – English, Odia
AI safety expert red-teaming conversational AI models for Mercor’s frontier-model training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.