Senior AI Product Manager – AI Builder
Posted 8hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior AI Product Manager building governed AI agents for WEX’s Mobility, Payments, and Benefits businesses. Prototyping workflows, evaluations, and production monitoring with forward-deployed Builder Pods.
Responsibilities:
- Embed with operators, customers, and domain experts across Mobility, Payments, and Benefits to map workflows, friction, and failure demand
- Define future-state experiences and baseline performance metrics including cycle time, manual hours, containment, and error rates
- Select high-value workflow slices to test feasibility and trust
- Rapidly build and test agent behavior, system context, prompts, tool flows, retrieval/grounding, and multi-agent or human-in-the-loop orchestrations
- Pair with the Tech Builder to adjust repositories and configurations, test scenarios, examine execution traces, and debug agent logic
- Distinguish exploratory learning prototypes from production systems requiring engineering hardening
- Define representative, edge-case, and adversarial AI evaluation scenarios
- Establish pass/fail criteria, assertions, and scoring rubrics for accuracy, tool selection, citation quality, policy adherence, hallucination rates, PII/PHI/PCI safety, and cost per outcome
- Analyze failed traces and build error taxonomies across prompt, context, retrieval, model, and UX issues
- Translate learnings into versioned repository artifacts including PRDs, acceptance criteria, decision logic, eval harnesses, and production metrics
- Maintain traceability from user problem through workflow, requirement, scenario, evaluation, and production metric
- Navigate legacy systems, fragmented APIs, and complex operational policies to demonstrate working software in real environments
- Partner with Risk, Compliance, Security, Legal, and AI Governance on decision boundaries, entitlements, auditability, prompt-injection defenses, and fallback controls
- Instrument live product usage to connect agent performance with business ROI
- Package reusable patterns, runbooks, and controls for domain teams to operate and extend mature solutions
Requirements:
- 7+ years of Product Management experience shipping software, data, platform, automation, or AI products to production at scale
- Direct experience with generative AI, LLMs, retrieval/grounding (RAG), tool calling, context management, orchestration, structured outputs, and human-in-the-loop workflows
- Proven experience building or running AI evaluations using golden datasets, quality rubrics, failure analysis, or model-based judges
- Ability to use AI-assisted development tools, low-code frameworks, APIs, and version-controlled Markdown, JSON, and YAML configuration files
- Skill in balancing accuracy, autonomy, latency, token/system cost, security, and user experience
- Understanding of when to use probabilistic AI versus deterministic code
- Track record driving alignment across Engineers, Risk, Legal, and Operations
- Bachelor’s degree in a related field or equivalent practical experience
- Preferred: experience in regulated industries such as Fintech, Payments, Health/Benefits, Fleet, or Financial Services
- Preferred: experience with enterprise AI governance frameworks, model risk management, responsible AI, or auditability
- Preferred: hands-on experience with agent frameworks, prompt/context engineering tools, or AI experimentation platforms
Benefits:
- Health, dental and vision insurances
- Retirement savings plan
- Paid time off
- Health savings account
- Flexible spending accounts
- Life insurance
- Disability insurance
- Tuition reimbursement
- Quarterly or annual bonus eligibility for non-sales roles
- Comprehensive and market competitive benefits
- Total compensation package




















