Head of AI Safety
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Head of AI Safety leading Moonshot's applied AI safety portfolio across violence, extremism, child safety, and crisis risks. Advising frontier AI companies, governments, and regulators through evaluations, interventions, and team leadership.
Responsibilities:
- Lead and quality-assure Moonshot's applied AI safety work across violence, extremism, CSEA, abuse and grooming, mental health and crisis, and child and teen risk categories.
- Advise frontier AI companies on improving model, product, policy, and intervention safety.
- Translate specialist insights into actionable guidance for model safety, policy, product, research, and engineering teams.
- Set methodological approaches and structured, testable evaluation frameworks.
- Lead and participate in red teaming and adversarial evaluation using test scenarios, model responses, scoring criteria, safety policies, and evaluation results.
- Identify safety failures and develop recommendations for model behavior and user protections.
- Maintain rigorous documentation for technical, government, and foundation audiences.
- Ensure ethical, legal, contractual, data protection, and compliance obligations are met.
- Manage operational, reputational, delivery, and partnership risks.
- Serve as Moonshot's primary applied AI safety counterpart for AI companies, governments, regulators, and ecosystem partners.
- Build relationships with technical teams, governments, foundations, academics, researchers, civil society organizations, and practitioners.
- Represent Moonshot in meetings, briefings, workshops, and sector engagement.
- Lead, coach, and manage the AI safety team; support workforce planning, performance management, and professional development.
- Coordinate with operations, finance, research, and technical teams.
- Develop the AI safety portfolio, strategic opportunities, partnerships, and funding.
- Lead proposal development, scoping, renewals, communications, publications, briefings, and thought leadership.
- Develop repeatable methodologies and service offerings while maintaining rigor and delivery quality.
- Oversee project planning, staffing, budgeting, forecasting, and delivery timelines.
Requirements:
- Experience in trust & safety, online harms, violence prevention, safeguarding, public health, or a closely related field.
- Ability to adapt relevant harm-prevention knowledge to AI systems.
- Curiosity about AI and ability to build technical fluency quickly.
- Experience designing research, evaluation frameworks, or interventions for violent extremism, CSEA, self-harm and crisis, or targeted violence.
- Experience managing projects, teams, budgets, partners, and clients.
- Strong people management skills.
- Excellent written communication and experience producing credible material for government, foundation, or enterprise audiences.
- Resilience and comfort working with highly sensitive or graphic content.
- Strong judgment and ability to navigate ambiguity, competing priorities, and sensitive stakeholder environments.
- Willingness to travel and work outside regular hours when needed.
- Trustworthiness, discretion, diplomacy, and willingness to undertake relevant security clearance procedures.
- Experience supporting business development, grant funding, or procurement.
- Commitment to Moonshot's mission.
- Eligibility to work in the US.
- Ability to pass relevant security clearance procedures per client needs.
- Desirable: experience in model safety, red teaming, or adversarial evaluation of LLMs or other AI systems.
- Desirable: understanding of LLM architecture, safety tooling, or trust & safety policy.
- Desirable: child safety evaluation, teen-safety product work, or grooming and CSEA detection experience.
- Desirable: government or regulatory engagement experience.
- Desirable: intervention or diversion program design experience.
- Desirable: academic or applied background in radicalization studies, forensic psychology, or violence risk assessment.
- Desirable: familiarity with taxonomy or classifier development and testing data.
Benefits:
- 15 days paid vacation leave, plus Federal holidays and 1 day additional paid leave for Native American Heritage Day.
- Flexible public holiday policy with the option to work federal holidays in exchange for a day off at another time.
- Full private healthcare package, including coverage for partners and children.
- Dental & Vision Insurance.
- Life & Disability Insurance.
- 24/7 access to free counseling via our Employee Assistance Program.
- 3% matched 401k contributions.
- 401(k) Roth Contributions.
- Generous maternity and paternity leave: 26 weeks paid maternity leave, 8 weeks paid paternity leave.
- All permanent employees are granted share options upon employment.
Similar Jobs
Senior Developer, Artificial Intelligence
Desenvolvedor(a) sênior criando aplicações LLM, copilots e agentes para a consultoria tecnológica SEIDOR. Integrando IA, APIs, dados e arquiteturas GenAI.
Agency Director – AI, Systems, Straight Talk
Agenturleiter für CAMPUS FÜR DIGITALE WERTE, Anbieter digitaler Marketing- und Erfahrungsberichte-Lösungen. Führung, KI-Integration, Plattformsteuerung, Vertrieb und KPI-gesteuerte Skalierung der Agentur.
Desarrollador/a – Producto AI Conversacional, AI-First
Desarrollador/a diseñando sistemas conversacionales AI-first para Yalfer. Integrando LLMs, agentes y flujos escalables con Python, Next.js y AWS.
Head of AI Safety
Head of AI Safety leading applied AI system evaluations and advisory work at Moonshot. Managing teams, partnerships, and portfolio growth across violence prevention and online harms.
AI Agent Evaluator
Evaluating Hippocratic AI’s clinical agents for symptom triage, diabetes medication titration, and travel health guidance. Providing safety-focused feedback to improve AI-driven healthcare tools.
Sustainability Metrics Governance, AI Specialist
Sustainability metrics specialist improving ESG data governance and AI-enabled reporting at GE Vernova. Monitoring KPIs, validating disclosures, and deploying scalable automation solutions.
Generative AI Analyst, Portuguese
Generative AI Analyst reviewing Portuguese AI content for Welo Data’s global AI training systems. Annotating multimedia data and performing quality checks to improve advanced AI datasets.
AI User Interview Specialist
Paid 60-minute Terac interview examining how professionals use generative and analytical AI tools. Sharing workflow pain points and proposing future capabilities for AI products.
Director, AI and Technology Enablement
Director leading Salesforce, AI workflow, and technology enablement for TMG, a leadership advisory firm. Translating business priorities into practical systems, data processes, vendor implementations, and user adoption.
Internship – AI-Based Semantic Mapping for Autonomous Driving
CARIAD automotive software intern researching radar-camera fusion and semantic mapping for autonomous driving. Developing and evaluating multimodal perception methods for complex vehicle environments.
AI Subject Matter Expert
AI subject matter expert advising Veterans Affairs on responsible AI governance, risk, and lifecycle management. Translating AI strategy into operational guidance for healthcare programs and leaders.
AI Consultant – Contract
AI Consultant leading enterprise AI initiatives focused on evaluating, designing, and implementing AI solutions. Collaborating with stakeholders and ensuring compliance with governance and security standards.
Director, Safety and PV Systems – Innovation, AI
Director of Safety and PV Systems at Syneos Health responsible for technology solutions and cross-functional execution. Leading AI innovations and managing senior teams for patient safety analytics.
AI Solution Strategist
AI Solution Strategist at NICE developing conversational AI agents. Collaborating with cross-functional teams to define, design, and launch AI solutions for customer success.
Associate Director, AI for Manufacturing and Operations
AI Subject Matter Expert at RTX developing scalable AI solutions for manufacturing and operations. Collaborating with teams to enhance productivity, quality, and decision-making in factories.
AI Operations & Automation Intern – Summer 2026
AI Operations & Automation Intern focusing on enhancing VSC workflows and automating processes. Engage with teams to identify efficiencies and implement AI solutions during a summer internship.
AI Training Specialist, Data Annotation
AI Training Specialist responsible for data annotation to train AI systems and improve accuracy. This fully remote role focuses on data labeling and quality assurance.
Founding Director – AI Digital Strategy
Founding Director leading AI-driven digital strategy engagements for mid-market clients. Overseeing migrations, strategy layers, and AI agent deployments in a pioneering digital landscape.
AI Technology Risk Manager
AI Technology Risk Manager managing technology risks associated with machine learning and generative AI solutions. Partnering with teams to ensure ethical and compliant AI practices at Empower.
Commercial Real Estate Specialist – AI Training Project
Consultancy role seeking experienced Commercial Real Estate Specialist to analyze property scenarios. Working remotely with a focus on market analysis and feasibility studies.