AI Safety Practitioner
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Safety Practitioner evaluating frontier AI models for Mercor, which partners with AI labs and enterprises to train advanced systems. Assessing sensitive content, applying safety rubrics, and providing structured alignment feedback.
Responsibilities:
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains
- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations
- Provide structured feedback to improve model alignment and safety performance
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives
Requirements:
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline
- 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field
- Excellent written English
- Critical thinking and analytical reasoning skills
- Ability to consistently evaluate nuanced and policy-sensitive scenarios
- Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation preferred
- Familiarity with safety policies, content moderation, or evaluation rubric development preferred
- Experience reviewing complex, high-risk, or ambiguous content preferred
- Must be eligible to work in one of the listed location-requirement countries
- H1-B and STEM OPT candidates are not supported
Benefits:
- Fully remote role
- Flexible own schedule
- Weekly payments via Stripe or Wise based on services rendered
- Competitive pay
- Collaboration with leading AI researchers, engineers, and safety teams
- Opportunity to shape the safety and behaviour of frontier AI models
- Reasonable accommodations upon request
- Referral bonus of up to $400 for each successful referral
- No limit on the number of referrals
Similar Jobs
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor’s AI research partners. Designing adversarial prompts, finding vulnerabilities, and improving model safety and alignment.
Digital Transformation, AI Management
AI transformation specialist leading automation, Microsoft 365 adoption, and process improvement. Supporting an Australian automotive aftermarket company through roadmap, governance, training, and vendor management.
AI Model Training Expert – Face Motion Data Contributor
Face-motion contributor recording short videos for Perle AI's computer vision training data. Completing simple camera-based tasks remotely across six eligible countries.
AI Model Training Expert – Face Motion Data Contributor
Face-motion contributor recording short videos for Perle AI’s computer vision training data. Completing simple camera-based tasks for future paid AI training projects.
AI Workforce Enablement Lead
AI workforce enablement lead driving adoption and behavior change for Progressive Leasing’s FinTech transformation. Designing manager toolkits, learning programs, and AI-enabled workflow support.
Principal Technologist – AI and Data Center Networking
Principal Technologist architecting AI/HPC networking and data center solutions for DriveNets, a high-scale networking software company. Leading strategic pre-sales engagements, proofs of concept, and technical go-to-market enablement.
AI Creator
AI Creator producing performance video, static, and audio creatives for HOLYWATER TECH’s AI-driven entertainment products. Developing conversion-focused concepts for Meta, TikTok, and Snapchat.
AI Change Lead
AI Change Lead driving adoption, learning, communications, and governance for D-ploy’s enterprise AI initiatives. Coordinating stakeholders, events, AI Champions, rollout plans, and programme reporting.
Technical AI Quality Coordinator
Technical AI Quality Coordinator improving AI data quality for RWS’s global content and language services. Automating checks, building testing frameworks, and monitoring annotation and model-evaluation pipelines.
Director of AI and Educational Technology
Teach For All leader advancing global teacher-workforce policy and government partnerships. Building coalitions and supporting network partners across eligible remote locations.
Working Student AI Transformation
Working student helping casavi, a German PropTech company, turn AI ideas into practical tools and workflows. Supporting internal AI adoption across property-management software teams.
AI Safety Experts – English, Malay
AI red teaming expert probing frontier models for Mercor, which partners with AI labs and enterprises to train advanced models. Generating reproducible attack data and vulnerability reports to improve AI safety and robustness.
AI Safety Expert, English, Danish
AI red team expert attacking conversational models for Mercor, which partners with AI labs and enterprises to train frontier systems. Generating reproducible vulnerability data, attack cases, and safety evaluations for customers.
Workflow & AI Agent Engineer
Workflow and AI Agent Engineer supporting Chatarmin’s B2B e-commerce SaaS clients. Owning onboarding, support, API/LLM solutions, and product feedback loops.
AI Strategy – Digital Implementation
Werkstudent:in entwickelt Website, App und Klinik-Dashboard für Xeno Patchs wachsendes MedTech-Produktportfolio. Integration digitaler Bausteine, Feature-Tests und schnelle KI-gestützte Umsetzung neuer Funktionen.
Senior Analyst, Artificial Intelligence
Analista Sênior criando soluções de IA, LLMs e pipelines de dados para a digitalização industrial da Vetta. Projetando arquiteturas escaláveis em Databricks, AWS e Azure para otimizar operações e apoiar a descarbonização.
Senior Manager – AI Strategy and Execution
AI Strategy & Execution Senior Manager helping Elliott Davis consulting clients turn AI into measurable business value. Leading AI roadmaps, governance, workflows, transformation, and client engagements end to end.
AI Literacy Manager
AI literacy manager scaling responsible AI education at Amgen, a biotechnology company developing innovative human therapeutics. Leading enterprise training, engagement, adoption, and go-to-market programs.
Senior Developer, Artificial Intelligence
Desenvolvedor(a) sênior criando aplicações LLM, copilots e agentes para a consultoria tecnológica SEIDOR. Integrando IA, APIs, dados e arquiteturas GenAI.
Agency Director – AI, Systems, Straight Talk
Agenturleiter für CAMPUS FÜR DIGITALE WERTE, Anbieter digitaler Marketing- und Erfahrungsberichte-Lösungen. Führung, KI-Integration, Plattformsteuerung, Vertrieb und KPI-gesteuerte Skalierung der Agentur.