Head of AI Safety
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Head of AI Safety leading applied AI system evaluations and advisory work at Moonshot. Managing teams, partnerships, and portfolio growth across violence prevention and online harms.
Responsibilities:
- Lead and quality-assure Moonshot's applied AI safety work across violence, extremism, CSEA, abuse and grooming, mental health and crisis, and child and teen risk categories.
- Advise frontier AI companies on improving model, product, policy, and intervention safety.
- Translate subject-matter expertise into actionable guidance for model safety, policy, product, research, and engineering teams.
- Set methodological approaches and develop structured, testable evaluation frameworks.
- Lead and participate directly in red teaming and adversarial evaluation of AI systems.
- Identify safety failures and develop recommendations for model behaviour and user protections.
- Maintain rigorous documentation and ensure compliance with legal, data protection, contractual, and ethical obligations.
- Manage operational, reputational, delivery, and partnership risks.
- Serve as Moonshot's primary applied AI safety counterpart for partners, governments, regulators, and the wider ecosystem.
- Build relationships with AI company teams, governments, foundations, academics, researchers, civil society organizations, and practitioners.
- Represent Moonshot externally in meetings, briefings, workshops, and sector engagement.
- Lead, coach, and manage the AI safety team.
- Support workforce planning, performance management, professional development, and team wellbeing.
- Coordinate with operations, finance, research, and technical teams.
- Develop the AI safety portfolio through strategic opportunities, partnerships, and funding.
- Lead proposal development, scoping, and renewals.
- Develop repeatable methodologies, service offerings, and partnerships.
- Support communications, publications, briefings, and thought leadership.
- Oversee project planning, staffing, budgeting, forecasting, and delivery timelines.
Requirements:
- Experience in trust & safety, online harms, violence prevention, safeguarding, or public health, with ability to adapt knowledge to AI systems.
- Curiosity about AI and ability to build technical fluency quickly.
- Experience designing research, evaluation frameworks, or interventions for violent extremism, CSEA, self-harm and crisis, or targeted violence.
- Experience managing projects, teams, budgets, partners, and clients, with strong people management skills.
- Excellent written communication for government, foundation, or enterprise audiences.
- Resilience working with highly sensitive or graphic content, with awareness of wellbeing practices.
- Strong judgment navigating ambiguity, competing priorities, and sensitive stakeholder environments.
- Willingness to travel and work outside regular hours when needed.
- Trustworthiness, discretion, diplomacy, and willingness to undertake security clearance procedures.
- Experience supporting business development, grant funding, or procurement.
- Commitment to Moonshot's mission.
- Eligibility to work in Canada.
- Required to pass a standard background check and relevant security clearance procedures per client needs.
- Desirable: direct experience in model safety, red teaming, or adversarial evaluation of LLMs or other AI systems.
- Desirable: understanding of LLM architecture, safety tooling, or trust & safety policy.
- Desirable: child safety evaluation, teen-safety product work, or grooming and CSEA detection experience.
- Desirable: government or regulatory engagement experience.
- Desirable: intervention or diversion programme design experience.
- Desirable: academic or applied background in radicalization studies, forensic psychology, or violence risk assessment.
- Desirable: familiarity with taxonomy or classifier development and testing data.
Benefits:
- 25 days paid vacation leave, plus Statutory Holiday
- Flexible public holiday policy with the option to work statutory holidays in exchange for a day off at another time.
- Group healthcare package, including coverage for partners and children (80% Co-Insurance).
- HSA is restricted to mental health practitioners only
- Dental & Vision Insurance (80% Co-Insurance).
- Life & LTD Disability Insurance.
- 24/7 access to counselling via our Employee Assistance Program.
- Generous maternity and paternity leave: 26 weeks paid maternity leave, 8 weeks paid paternity leave.
- All permanent employees are granted share options upon employment.
Similar Jobs
Senior Developer, Artificial Intelligence
Desenvolvedor(a) sênior criando aplicações LLM, copilots e agentes para a consultoria tecnológica SEIDOR. Integrando IA, APIs, dados e arquiteturas GenAI.
Agency Director – AI, Systems, Straight Talk
Agenturleiter für CAMPUS FÜR DIGITALE WERTE, Anbieter digitaler Marketing- und Erfahrungsberichte-Lösungen. Führung, KI-Integration, Plattformsteuerung, Vertrieb und KPI-gesteuerte Skalierung der Agentur.
Desarrollador/a – Producto AI Conversacional, AI-First
Desarrollador/a diseñando sistemas conversacionales AI-first para Yalfer. Integrando LLMs, agentes y flujos escalables con Python, Next.js y AWS.
Head of AI Safety
Head of AI Safety leading Moonshot's applied AI safety portfolio across violence, extremism, child safety, and crisis risks. Advising frontier AI companies, governments, and regulators through evaluations, interventions, and team leadership.
AI Agent Evaluator
Evaluating Hippocratic AI’s clinical agents for symptom triage, diabetes medication titration, and travel health guidance. Providing safety-focused feedback to improve AI-driven healthcare tools.
Sustainability Metrics Governance, AI Specialist
Sustainability metrics specialist improving ESG data governance and AI-enabled reporting at GE Vernova. Monitoring KPIs, validating disclosures, and deploying scalable automation solutions.
Generative AI Analyst, Portuguese
Generative AI Analyst reviewing Portuguese AI content for Welo Data’s global AI training systems. Annotating multimedia data and performing quality checks to improve advanced AI datasets.
AI User Interview Specialist
Paid 60-minute Terac interview examining how professionals use generative and analytical AI tools. Sharing workflow pain points and proposing future capabilities for AI products.
Director, AI and Technology Enablement
Director leading Salesforce, AI workflow, and technology enablement for TMG, a leadership advisory firm. Translating business priorities into practical systems, data processes, vendor implementations, and user adoption.
Internship – AI-Based Semantic Mapping for Autonomous Driving
CARIAD automotive software intern researching radar-camera fusion and semantic mapping for autonomous driving. Developing and evaluating multimodal perception methods for complex vehicle environments.
AI Subject Matter Expert
AI subject matter expert advising Veterans Affairs on responsible AI governance, risk, and lifecycle management. Translating AI strategy into operational guidance for healthcare programs and leaders.
AI Consultant – Contract
AI Consultant leading enterprise AI initiatives focused on evaluating, designing, and implementing AI solutions. Collaborating with stakeholders and ensuring compliance with governance and security standards.
Director, Safety and PV Systems – Innovation, AI
Director of Safety and PV Systems at Syneos Health responsible for technology solutions and cross-functional execution. Leading AI innovations and managing senior teams for patient safety analytics.
AI Solution Strategist
AI Solution Strategist at NICE developing conversational AI agents. Collaborating with cross-functional teams to define, design, and launch AI solutions for customer success.
Associate Director, AI for Manufacturing and Operations
AI Subject Matter Expert at RTX developing scalable AI solutions for manufacturing and operations. Collaborating with teams to enhance productivity, quality, and decision-making in factories.
AI Operations & Automation Intern – Summer 2026
AI Operations & Automation Intern focusing on enhancing VSC workflows and automating processes. Engage with teams to identify efficiencies and implement AI solutions during a summer internship.
AI Training Specialist, Data Annotation
AI Training Specialist responsible for data annotation to train AI systems and improve accuracy. This fully remote role focuses on data labeling and quality assurance.
Founding Director – AI Digital Strategy
Founding Director leading AI-driven digital strategy engagements for mid-market clients. Overseeing migrations, strategy layers, and AI agent deployments in a pioneering digital landscape.
AI Technology Risk Manager
AI Technology Risk Manager managing technology risks associated with machine learning and generative AI solutions. Partnering with teams to ensure ethical and compliant AI practices at Empower.
Commercial Real Estate Specialist – AI Training Project
Consultancy role seeking experienced Commercial Real Estate Specialist to analyze property scenarios. Working remotely with a focus on market analysis and feasibility studies.