AI Safety Expert
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Safety Expert evaluating and improving AI safety and reliability at mpathic.ai. Ideal for professionals with expertise in human behavior or trust & safety.
Responsibilities:
- Evaluating AI-generated conversations, responses, and reasoning for quality, safety, and usefulness
- Rating model outputs using structured evaluation rubrics and project guidelines
- Annotating conversational data to support AI training and benchmarking
- Identifying emerging risks, behavioral patterns, and opportunities for model improvement
- Providing written feedback that helps researchers and engineers improve model performance
- Maintaining strict confidentiality while working with proprietary AI systems and sensitive content
- Participating in calibration sessions and quality reviews to ensure consistent evaluations
Requirements:
- Professional experience or subject matter expertise in a relevant field such as psychology, behavioral science, social work, trust & safety, research, or a related discipline
- Strong written communication skills with excellent attention to detail
- Comfortable learning structured evaluation frameworks and applying them consistently
- Strong critical thinking and problem-solving skills
- High ethical standards and sound judgment when working with sensitive or ambiguous content
- Comfortable using AI tools, Google Workspace, Slack, and other web-based collaboration platforms
- Willingness to sign NDAs and work on confidential projects
Similar Jobs
Student II – AI/ML Governance
Student II role at Cincinnati Children's focusing on AI/ML Governance and healthcare/research. Responsibilities include learning daily routines, fostering career interests, and complying with healthcare policies.
Forward Deployed AI Accelerator
Forward Deployed AI Accelerator at Stripe leveraging AI to enhance marketing workflows. Collaborating closely with a team of marketers for efficient operations and transformations.
Senior Analyst, Compute AI Modeling
Senior Analyst specializing in Compute AI modeling within TechInsights, a semiconductor market intelligence platform. Focus on modeling development and mentoring junior analysts.
AI Builder
AI Builder developing AI solutions for personalized diet and lifestyle coaching services. Building internal tools and features while collaborating with the coaching team and product manager.
AI-First Marketing Operator
AI-First Marketing Operator managing Storm's marketing engine with a focus on AI tools and automation. Creating authoritative content, campaigns, and visual storytelling while improving workflows continuously.
AI-First Marketing Operator
AI-First Marketing Operator at Storm Ideas focused on building AI-driven marketing engines. Engaging with brands in US entertainment while leveraging AI tools and strategies.
AI-First Marketing Operator
AI-First Marketing Operator managing Storm Ideas' AI-driven marketing engine. Creating high-quality marketing assets and overseeing SEO and brand strategies in a remote role.
AI-First Marketing Operator
AI-First Marketing Operator role at Storm Ideas. Responsible for creating and directing marketing strategies powered by AI tools.
AI Co-Founder / CEO
AI Co-Founder / CEO leading startups in AI, with 1:1 mentorship from unicorn founders. Building transformative tech startups with potential for €1B+ revenue.
Gen AI
Generative AI Engineer developing cloud-based Generative AI solutions at Elfonze Technologies. Responsibilities include Python programming, API integration, and DevOps practices for scalable infrastructure.
Principal AI Technologist
Principal AI Technologist driving AI security initiatives and customer engagements at Cyera. Collaborating with cross-functional teams to enhance AI governance and risk management.
Especialista II – Soluções de Inteligência Artificial
Senior AI Architect translating complex business challenges into viable AI architectures at Grupo Boticário. Collaborating with teams to deliver impactful AI solutions for the beauty industry.
Senior Consultant – VMDR, GDS Cyber – Frontier AI
Senior Cyber AI Engineer at EY focusing on AI-driven Cybersecurity and Vulnerability Management. Involves mentoring teams and shaping AI-driven capabilities within security operations.
IAM Manager, Cyber-AI Driven
IAM AI Manager focusing on modernizing Identity and Access Management through AI-led solutions. Collaborate with clients to improve governance, access risk management, and compliance posture.
AI Transformation Manager
AI Transformation Manager facilitating AI adoption across Business Units at Modaxo, a leader in people transportation technology. A hands-on role driving initiatives and commercial value through AI.
Director, Enterprise AI Transformation
Director leading Cint’s enterprise AI transformation office driving measurable business value. Overseeing AI strategy and roadmap while managing high-impact teams and complex workflows.
Director, Enterprise AI Transformation
Director of Enterprise AI Transformation at Cint leading AI-enabled operational change. Focused on measurable business value and managing AI transformation portfolio.
Director, Enterprise AI Transformation
Director of AI Transformation leading enterprise AI initiatives at Cint to drive operational change and measurable business value. Collaborating with global teams to optimize AI workflows and governance frameworks.
VP, Global HR Business Partner – Business AI, Technology & Product
VP, Human Resources Business Partner leading HR strategies and talent development for global BATP organization. Collaborating with senior leaders to shape people strategies that support growth and innovation.
AI Transformation Manager
AI Transformation Manager at Modaxo driving AI use cases and initiatives across Business Units. Hands-on role connecting business leaders with AI opportunities and overcoming implementation obstacles.