Staff AI Operations Lead
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff AI Operations Lead deploying reliable, governed AI workflows across Honeycomb.io’s business operations. Building shared infrastructure, enablement, and adoption practices for the observability company.
Responsibilities:
- Partner with department leaders to identify high-leverage workflows and determine where AI models help
- Define success metrics such as cycle time, quality, cost, and risk; instrument and report results honestly
- Deliver production systems with evaluation harnesses, human-in-the-loop review, and ongoing monitoring
- Drive adoption through user research, documentation, and implementation plans
- Establish patterns for model access, orchestration, agents, prompt and tool management, evaluation, logging, and cost control
- Build on the Data team’s existing infrastructure
- Co-own shared components with Engineering and coordinate dependencies in partner roadmaps
- Create templates, playbooks, golden paths, safety checklists, and evaluation patterns
- Run office hours, demos, and community-of-practice sessions
- Develop AI enablement materials for GTM, operations, and leadership
- Help employees develop judgment about when and how to use AI
- Partner with Security, IT, and Legal on access control, data handling, vendor risk, and policy
- Apply data classification standards to AI use cases and define required audit trails for sensitive data in LLM pipelines
Requirements:
- Deep experience shipping systems into real business workflows, owning something end to end in production that non-technical people depended on daily
- Hands-on fluency with modern AI stacks: LLMs, retrieval, tool use and agents, evaluation, and guardrails
- Ability to learn business functions such as support, sales, or finance well enough to improve them
- Track record of leading cross-functional initiatives without formal authority
- Comfort navigating security, privacy, and compliance tradeoffs, including data classification, retention, access controls, and vendor risk
- Strong teaching instincts; ability to explain complex things simply and write clear documentation
- Demonstrated ability to stay current as the landscape shifts and change your mind based on evidence
- SQL fluency and comfort in a modern data stack (nice to have)
- Experience with workflow automation or enterprise systems (nice to have)
- Familiarity with observability practices for AI systems (nice to have)
- Change management experience across a distributed, multi-function company (nice to have)
- Interest in external evangelism (nice to have)
- Must be able to verify identity and eligibility to work
- Honeycomb cannot currently sponsor or support visa transfers
Benefits:
- Generous equity with employee-friendly stock program
- Transparent pay based on levels relative to experience
- Unlimited PTO
- Distributed-first mindset and culture
- Home office, co-working, and internet stipend
- Full benefits coverage for employees, with additional coverage available for dependents
- Up to 16 weeks of paid parental leave, regardless of path to parenthood
- Annual development allowance
- Reasonable accommodations during the hiring process
Similar Jobs
IT Operations Engineer
IT Operations Engineer supporting employees, devices, identity, and SaaS tools at Finom. Troubleshooting Windows and macOS systems for a growing European fintech.
Director of Operations
Director of Operations overseeing beBright’s dental practice operations, KPIs, and financial performance. Coaching practice leaders and standardizing processes to support patient experience and sustainable growth.
Junior Ad Operations Specialist
Junior Ad Operations Specialist managing campaigns across Eskimi DSP, Google, and Meta. Optimizing delivery and reporting performance for Eskimi’s global digital advertising platform.
Lead Revenue Accountant, Operations Analyst
Lead revenue accounting and operations for ChargePoint’s EV charging network. Own ASC 606 compliance, close execution, automation, and revenue reporting.
Customer Operations Specialist – Contract
Customer Operations Specialist supporting OpenTable’s restaurant-booking operations in the Philippines. Managing account data, operational reports, quality audits, and process improvements for international customers.
Rental Field Operations Manager
The Home Depot rental operations manager leading Texas regional fleet performance, maintenance, safety, and customer service. Managing technicians, stores, compliance, and operational profitability.
Staff AI Operations Lead
Staff AI Operations Lead shipping governed AI workflows across Honeycomb.io’s business operations. Building shared AI infrastructure, enablement, and adoption on the Data team.
Operations Manager – Global Strategic Accounts
Operations Manager leading distributed coordinators and contract coaches. Delivering Thrive Global’s AI-powered wellbeing programs for a major enterprise account worldwide.
Global Head of Field Ops
Global Head of Field Operations optimizing revenue operations and GTM performance at Wiz. Leading global operations teams for a cloud and AI security platform powered by Google.
Manager, Strategy & Operations
Strategy and operations manager running cadence, metrics, contracts, and risk for FutureFit AI. Supporting leadership decisions at a SaaS/AI workforce development company.
Manager, Biosample Operations
Biosample Operations Manager overseeing patient-sample logistics across Kura Oncology’s precision-medicine clinical trials. Coordinating vendors, compliance, collection, processing, storage, and disposition.
Executive Operations Manager
Executive Operations Manager driving Phoenix Rescue Mission’s Christian ministry leadership operations. Coordinating ELT initiatives, CEO support, Board governance, and organizational projects.
Operations Manager, Property Concierge Services
Responsable Airbnb indépendant gérant et optimisant des locations courte durée pour ALB Conciergerie. Développement d’un portefeuille de propriétaires et coordination des séjours.
Global Operations Specialist II
Global Operations Specialist II managing escalations, quality controls, and compliance workflows for ClearStar’s employment intelligence and background screening services.
Platform Operations Lead
Edifecs Platform Operations Lead managing healthcare EDI applications, AWS infrastructure, and transaction workflows for SAIC. Driving platform stability, scalability, compliance, and roadmap execution.
Senior Substrate Supplier Engineering and Operations Lead
Intel supply chain lead optimizing semiconductor substrate supplier quality, yield, cost, and operations. Managing supplier selection, process validation, KPIs, and quality improvements in South Korea.
Operations Assistant
Part-time remote Operations Assistant supporting Learn To Be’s free 1-on-1 K–12 tutoring program. Managing student-tutor pairings and improving operations with AI tools.
Country Operations Lead
Clinical operations leader overseeing UK-based FSP portfolios for Thermo Fisher Scientific. Driving client delivery, team capability, quality, risk, resources and financial performance.
Operations and Admin Coordinator
Remote Operations & Admin Coordinator supporting a fundraising consultancy and training business. Handling invoicing, client onboarding, content scheduling, document formatting, and systems administration.
Operations Manager – eCommerce, DTC
Operations Manager scaling supply chain, fulfillment, people, and processes for a growing physical-product DTC/eCommerce brand. Building SOPs, systems, reporting, and accountability across the company.