AI Safety Practitioner
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI safety practitioner evaluating frontier models for Mercor, which partners with AI labs to train and enhance AI systems. Applying safety policies, identifying failures, and providing structured feedback on sensitive content.
Responsibilities:
- Evaluate AI-generated responses for safety, factual accuracy, policy compliance, and overall quality
- Review content involving misinformation, political persuasion, self-harm, violence, cyber, biosecurity, and other sensitive domains
- Apply and refine evaluation rubrics for RLHF, SFT, and AI safety benchmarking
- Identify unsafe outputs, hallucinations, reasoning failures, and policy violations
- Provide structured feedback to improve model alignment and safety performance
- Collaborate with AI researchers and safety teams on ongoing evaluation initiatives
- Work on projects focused on training and enhancing frontier AI systems
Requirements:
- Bachelor's degree or higher in Journalism, Communications, Psychology, Sociology, Public Policy, Law, Biology, Chemistry, Computer Science, or a related discipline
- 5+ years of professional experience in AI Safety, Trust & Safety, journalism, public policy, scientific research, security, or a related field
- Excellent written English
- Critical thinking and analytical reasoning skills
- Ability to consistently evaluate nuanced and policy-sensitive scenarios
- Experience with AI Safety, RLHF, SFT, Trust & Safety, or AI evaluation preferred
- Familiarity with safety policies, content moderation, or evaluation rubric development preferred
- Experience reviewing complex, high-risk, or ambiguous content preferred
- Must be able to work as an independent contractor
- H1-B and STEM OPT candidates are not supported
Benefits:
- Fully remote work
- Flexible own schedule
- Projects can be extended, shortened, or concluded early depending on needs and performance
- Weekly payments via Stripe or Wise based on services rendered
- Competitive pay
- Collaboration with leading AI researchers, engineers, and safety teams
- Opportunity to shape frontier AI models used by millions worldwide
- Up to $400 for each successful referral
- No limit on the number of referrals
- Reasonable accommodations upon request
Similar Jobs
Principal, AI Solutions
Principal AI solutions leader designing AI agents, workflows, and automations for Higher Logic’s community solutions. Partnering with business teams to improve workflows, adoption, and measurable organizational outcomes.
AI & No-Code Mentor, Vibe Coding Bootcamp
AI- und No-Code-Mentor für Digitale Leute School, die Bootcamps für Product, Design und Tech anbietet. Begleitung von Quereinsteigern beim Bau digitaler Produkte mit AI- und No-Code-Tools.
AI Safety Practitioner
AI Safety Practitioner evaluating frontier AI models for safety, quality, and alignment. Mercor partners with AI labs and enterprises to train and enhance AI systems.
AI Safety Practitioner
AI Safety Practitioner evaluating frontier AI models for Mercor, which partners with AI labs and enterprises to train advanced systems. Assessing sensitive content, applying safety rubrics, and providing structured alignment feedback.
AI Safety Practitioner
AI Safety Practitioner evaluating frontier AI models for Mercor’s AI lab partnerships. Applying safety policies and structured feedback across high-risk, ambiguous content domains.
Engineer II, AI – Copilot Agent
Healthcare RCM AI specialist building Microsoft Copilot agents and Power Automate workflows for Ensemble Health Partners. Improving revenue cycle operations through governed AI automation, knowledge management, and executive reporting.
Principal AI Process Orchestrator
Principal AI Process Orchestrator redesigning business workflows for Creative Chaos, an AI orchestration company. Leading client engagements, AI-agent implementations, and measurable operational transformation.
AI Professional – Feedback on Startup Outreach Copy
AI professionals review and compare startup outreach copy for Terac, which recruits vetted human experts for AI research. Providing concise feedback on clarity, tone, and effectiveness.
Senior Director Analyst – AI and Emerging Technologies Enterprise Strategy
Gartner Senior Director Analyst shaping AI and emerging-technology insights for enterprise leaders. Advising executives, researching market trends, and guiding technology strategy.
AI Generalist Intern
AI video studio intern running growth experiments, analyzing conversion funnels, talking with users, and testing products. Supporting competitive research and urgent operational work at HexCoded.
Associate Director, Data Governance, FAIR, AI-Readiness
Amgen biotechnology data governance leader advancing FAIR practices and trusted data products. Enabling responsible AI readiness across regulated scientific and business data.
VP, AI Audit – Shared Services
VP leading AI and GenAI audits for a bank’s governance, risk, and compliance. Assessing model risk, cybersecurity, regulations, and third-party AI platforms while developing audit teams.
AI Training Contributor, Luxembourgish
AI training contributor evaluating text, multimedia, and AI outputs for Lilt’s language technology. Applying Luxembourgish cultural expertise to annotations, quality assurance, and model improvement.
Head of AI
Head of AI building BCD’s enterprise AI capability and Centre of Excellence. Embedding AI into workflows and products for global corporate travel management.
AI Business Transformation Lead
AI Business Transformation Lead launching AI capabilities and redesigning work at BCD Travel, a global corporate travel services company. Driving adoption, change management and measurable productivity gains.
AI Enablement & Governance Manager
AI governance manager enabling secure agent automation for WCG’s clinical-trial solutions. Establishing enterprise registry, risk tiering, workflows, and adoption standards.
AI Automations & Data Specialist
AI automation and data specialist building Power BI, Python, SQL, and AI workflow systems for a remote cloud-accounting firm. Improving dashboards, data governance, integrations, and payout processes.
AI Intern
AI Intern supporting data preparation, machine learning models, and AI use cases at Terracon, a multidisciplinary engineering consulting firm. Gaining hands-on experience with mentorship and professional development.
AI Voice Data Collection Specialist, Indian English
English speakers recording natural conversations with AI bots for Arctic Engines, an enterprise AI training-data company. Completing auditions and remote speech sessions across varied topics.
French-Speaking Mac Users – Application-Level AI Audio Testing
French-speaking Mac freelancers testing enterprise AI audio applications. Evaluating generated audio, application behavior, bugs, and instruction adherence.