Product Manager, Agentic AI
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Product Manager owning agent orchestration, evaluation, and governance. Building AI-powered workers’ comp solutions at Kinetic for safer workplaces and faster claims outcomes.
Responsibilities:
- Own the roadmap for Kinetic's agent orchestration layer, including models and routing, tools and memory, observability, permissions, and guardrails
- Run the agent registry with documented ownership, purpose, autonomy tier, and behavior logging for every agent
- Define how agents are deployed, versioned, and rolled back
- Manage prompts, tool definitions, and model versions like code
- Track usage, cost, and latency per agent
- Lead cleanup of existing AI scripts and workflows by retiring, replatforming, or sunsetting them
- Keep business logic, specifications, and evaluation data portable across frameworks and models
- Partner with experience-team PMs to determine whether agents or simpler automation should solve business problems
- Translate use cases into agent specifications, including inputs, tools, autonomy boundaries, human escalation paths, success metrics, and baselines
- Write, test, and iterate on system prompts, tool descriptions, and structured outputs with agent and data engineers
- Tie every agent to a business metric before scaling
- Build golden datasets and run regression suites when prompts, tools, or models change
- Own rollout gates from shadow mode through staged rollout to full production
- Maintain the autonomy-tier policy and define required human checkpoints
- Produce architecture maps, evaluation histories, audit trails, and before-and-after metrics
- Report to the VP of Product and collaborate with product managers across Broker, Policyholder, Underwriter, Claims, Data, and Business Systems teams
Requirements:
- 5+ years in Product Management, Technical Product Management, or a similar role
- 1+ year shipping LLM-powered or agentic products into production, not just demos
- Hands-on prompt engineering: system prompts, tool definitions, multi-step chains, and structured outputs
- Experience building or running evaluation for LLM systems, such as golden datasets, LLM-as-judge graders, and regression testing
- Working knowledge of agent frameworks and platforms such as CrewAI, LangGraph, OpenAI Agents SDK, or AWS Bedrock AgentCore
- Working knowledge of RAG, tool calling, and MCP
- Ability to convert messy business needs into requirements, user stories, and acceptance criteria
- Experience in startups or high-growth environments
- Excellent communication skills and ability to explain probabilistic systems to business leaders
- Candidates must reside within the US
- Existing authorization to work in the United States
- Verification of government-issued identity and employment eligibility prior to employment
- Prior experience at an insurtech, MGA, carrier, or another regulated industry such as financial services or healthcare is a plus
- Familiarity with workers' compensation, commercial lines underwriting, or claims workflows is a plus
- Experience with AI governance frameworks is a plus
- Experience with multi-model routing, cost optimization, or human-in-the-loop design for agents is a plus
Benefits:
- Fully distributed, remote team across all continental US time zones
- Medical, dental, and vision insurance
- 20 vacation days per year
- 9 federal holidays off
- Parental Leave
- Pre-tax 401k contribution
- HSA with compatible health plans
- FREE: Health Advocate
- FREE: Telehealth Membership
- FREE: OneMedical Account
- Domestic travel for company offsites and team alignment
Similar Jobs
GIS Product Manager
GIS Product Manager owning enterprise product discovery, backlogs, delivery, and adoption. Driving safer communities through SambaSafety’s driver monitoring software.
Associate Product Manager – Associate Game Producer, Casino Games
Associate Product Manager / Game Producer creating proprietary casino games for Hard Rock Digital. Coordinating game development, quality, certification, launch, and performance across casino categories.
River Cruise Product Development Manager
Product Development Manager creating and launching Trafalgar river cruise itineraries across European waterways. Shaping guest experiences, supplier partnerships and profitable growth for TTC’s travel brands.
Product Manager
Product Manager owning loan servicing, payments, valuations, and integrations at Kiavi, a residential real-estate lender. Driving roadmap execution, operational automation, and AI-enabled product improvements.
Product Manager
Product Manager owning AI-forward features for Forge’s global B2B eCommerce platform. Translating customer needs into requirements and partnering with Design, Engineering, and QA.
Global Product Owner – Head of Entity Management
Global Entity Management leader owning product strategy, commercial growth, compliance, and delivery economics. Leading regional product and outsourcing teams for GoGlobal’s worldwide corporate-services operations.
Product Manager
Product Manager owning strategy, roadmap, pricing, and AI opportunities for Grace Hill’s SaaS platform. Improving talent performance for multifamily residential property companies.
Senior Product Manager – Virtual
Senior Product Manager shaping digital benefits, HR, wellbeing, retirement, and financial experiences at Alight. Owning product strategy, discovery, execution, and AI-enabled innovation.
Lead IT Product Manager
Lead IT Product Manager defining product strategy, roadmaps, and business value for Magellan Health. Managing portfolios, vendors, releases, financial planning, and client-facing delivery.
Principal Product Manager, Commerce
Principal Product Manager owning Recurly Commerce's strategy, roadmap, and commercial growth. Building a differentiated B2B commerce product through Shopify expertise and cross-functional execution.
Product Manager, Ignite Member Operations
Product Manager owning Ignite membership operations workflows for ABC Fitness, a global fitness-business software provider. Improving billing, access, member lifecycle, and club operations.
Product Manager
Product Manager owning backlogs, requirements, and launch execution for Olly Olly’s software, automation, and managed services serving local businesses. Remote across Mexico, Brazil, or Colombia.
Principal Product Manager
Principal Product Manager owning risk and compliance for RealPage Payments, RealPage’s property-management payments engine. Leading payment-risk products from strategy through launch, adoption, and optimization.
Product Manager, DTC Customer Journey – Shopify
Product Manager optimizing Paula’s Choice Shopify customer journeys from discovery through repeat purchase. Driving conversion, AOV, and LTV through roadmap leadership and experimentation.
Global Product Manager, Veterinary Imaging
Global Product Manager leading Movora’s veterinary imaging and minimally invasive visualization portfolio. Owning global strategy, profitability, launches, and commercial readiness across animal-health markets.
Senior Product Manager
Senior Product Manager guiding user-centered digital services for government agencies. Defining product strategy, priorities, and delivery with cross-functional teams and public-sector partners.
Product Manager, Clinical Content
Product Manager leading strategy, launches, and lifecycle management for NextGen Healthcare's ambulatory software products. Guiding cross-functional teams and enhancing outpatient care solutions.
Senior Product Manager
Senior Product Manager leading healthcare product roadmaps, customer-focused feature development, and compliant releases. Partnering with design, engineering, and go-to-market teams at RXNT.
Senior Product Manager, Customer Operations
Senior Product Manager owning customer-operations systems for Nuitée’s API infrastructure powering global travel. Improving fulfillment, reducing incidents, and optimizing support economics.
Entrepreneur in Residence – Product Lead
Entrepreneur in Residence/Product Lead turning agentic AI into workplace products at JetBrains. Validating customers, experiments, and commercialization with a technical founder and engineering team.