Staff AI Operations Lead

Posted 12hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Staff AI Operations Lead shipping governed AI workflows across Honeycomb.io’s business operations. Building shared AI infrastructure, enablement, and adoption on the Data team.

Responsibilities:

  • Partner with department leaders to identify high-leverage workflows and determine where AI models can help
  • Define success metrics such as cycle time, quality, cost, and risk; instrument and report results honestly
  • Deliver production-ready systems with evaluation harnesses, human-in-the-loop review, and ongoing monitoring
  • Drive user adoption through research, documentation, and implementation plans
  • Establish patterns for model access, orchestration, agents, prompt and tool management, evaluation, logging, and cost control
  • Build on the Data team's existing infrastructure
  • Co-own shared components with Engineering and coordinate dependencies in partner roadmaps
  • Create templates, playbooks, golden paths, safety checklists, and evaluation patterns
  • Run office hours, demos, and community-of-practice sessions
  • Develop AI enablement materials for GTM, operations, and leadership
  • Help teams develop judgment about when and how to use AI
  • Partner with Security, IT, and Legal on access control, data handling, vendor risk, and policy
  • Apply data classification standards to AI use cases and define audit-trail requirements for sensitive data in LLM pipelines

Requirements:

  • Deep experience shipping systems into real business workflows, including owning a production system end to end that non-technical people depended on daily
  • Hands-on fluency with modern AI stacks: LLMs, retrieval, tool use and agents, evaluation, and guardrails
  • Ability to learn business functions deeply enough to improve workflows
  • Track record of leading cross-functional initiatives without formal authority
  • Comfort navigating security, privacy, and compliance tradeoffs, including data classification, retention, access controls, and vendor risk
  • Strong teaching instincts, clear writing, and ability to explain complex concepts simply
  • Demonstrated ability to stay current as the AI landscape shifts and adapt based on evidence
  • SQL fluency and comfort with a modern data stack (dbt, cloud warehouse, BI tooling) (nice to have)
  • Experience with workflow automation or enterprise systems such as case management, ticketing, CRM, and knowledge bases (nice to have)
  • Familiarity with observability practices for AI systems, including monitoring, quality signals, evaluation pipelines, cost, and latency analysis (nice to have)
  • Change management experience across a distributed, multi-function company (nice to have)
  • Interest in external evangelism, including writing, speaking, podcasts, and peer groups (nice to have)
  • Must be eligible to work in Canada; visa sponsorship or visa transfers are not supported

Benefits:

  • Generous equity with employee-friendly stock program
  • Transparent pay based on levels relative to experience
  • Unlimited PTO
  • Distributed-first mindset and culture
  • Home office, co-working, and internet stipend
  • Full benefits coverage for employees, with additional coverage available for dependents
  • Up to 16 weeks of paid parental leave, regardless of path to parenthood
  • Annual development allowance
  • Reasonable accommodations during the hiring process