AI Safety Expert – English, Punjabi

Posted 6hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

AI red-teaming expert probing Mercor customer models with English and Punjabi adversarial inputs. Annotating vulnerabilities and producing reproducible safety datasets and attack reports.

Responsibilities:

  • Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
  • Annotate failures, classify vulnerabilities, and flag systemic risks
  • Apply taxonomies, benchmarks, and playbooks to keep testing consistent
  • Produce reproducible reports, datasets, and attack cases
  • Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
  • Help expand evaluation coverage and reduce production surprises
  • Work on projects training and enhancing frontier AI systems for Mercor’s customers

Requirements:

  • Native fluency in English and Punjabi
  • Strong judgment about language and content
  • Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
  • Ability to notice subtle errors, inconsistencies, and gaps
  • Ability to follow guidelines and quality standards consistently
  • Ability to explain reasoning clearly to technical and non-technical audiences
  • Adaptability across projects, task types, and customers
  • Independent contractor engagement
  • Must not be an H1-B or STEM OPT candidate
  • Nice-to-have experience in adversarial ML, cybersecurity, socio-technical risk, or creative probing

Benefits:

  • Fully remote role
  • Work on your own schedule
  • Weekly payments via Stripe or Wise based on services rendered
  • Optional participation in higher-sensitivity projects
  • Clear guidelines and wellness resources for higher-sensitivity projects
  • Reasonable accommodations upon request
  • Referral payments of up to $90 for each successful referral, subject to limits
  • Opportunity to collaborate with leading researchers
  • Experience in human data-driven AI red teaming at the frontier of safety