AI Safety Expert – English, Punjabi
Posted 6hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI red-teaming expert probing Mercor customer models with English and Punjabi adversarial inputs. Annotating vulnerabilities and producing reproducible safety datasets and attack reports.
Responsibilities:
- Red-team conversational AI models and agents using jailbreaks, prompt injections, misuse cases, bias exploitation, and multi-turn manipulation
- Annotate failures, classify vulnerabilities, and flag systemic risks
- Apply taxonomies, benchmarks, and playbooks to keep testing consistent
- Produce reproducible reports, datasets, and attack cases
- Review AI outputs involving sensitive topics such as bias, misinformation, or harmful behaviors
- Help expand evaluation coverage and reduce production surprises
- Work on projects training and enhancing frontier AI systems for Mercor’s customers
Requirements:
- Native fluency in English and Punjabi
- Strong judgment about language and content
- Ability to assess whether AI responses are accurate, complete, and appropriate, and explain why
- Ability to notice subtle errors, inconsistencies, and gaps
- Ability to follow guidelines and quality standards consistently
- Ability to explain reasoning clearly to technical and non-technical audiences
- Adaptability across projects, task types, and customers
- Independent contractor engagement
- Must not be an H1-B or STEM OPT candidate
- Nice-to-have experience in adversarial ML, cybersecurity, socio-technical risk, or creative probing
Benefits:
- Fully remote role
- Work on your own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Optional participation in higher-sensitivity projects
- Clear guidelines and wellness resources for higher-sensitivity projects
- Reasonable accommodations upon request
- Referral payments of up to $90 for each successful referral, subject to limits
- Opportunity to collaborate with leading researchers
- Experience in human data-driven AI red teaming at the frontier of safety









