Product Manager, Applied AI
Posted 20hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Product Manager shaping reliable generative and agentic AI products for CSI’s community and regional financial institution customers. Owning AI strategy, evaluation, LLMOps, and responsible production delivery.
Responsibilities:
- Own the vision, strategy, and roadmap for LLM-powered and agentic AI experiences across multiple products
- Identify high-value AI applications for users and translate them into a prioritized roadmap
- Balance experimentation with reliable delivery
- Turn probabilistic model capabilities into reliable, valuable, and trustworthy user experiences
- Define AI feature behavior, human-in-the-loop involvement, and graceful degradation when models are uncertain
- Work across emerging agentic patterns and tool/interface standards
- Define evaluation frameworks, quality bars, and guardrails balancing reliability, cost, latency, and safety
- Partner on evaluation, observability, and LLMOps tooling and operating practices
- Use quantitative and qualitative signals to improve AI feature performance
- Champion responsible AI across the product lifecycle
- Partner with risk and compliance stakeholders in a regulated financial-services environment
- Collaborate with AI architecture, data science, engineering, and design to ship AI features from concept to production
- Communicate AI capabilities, limitations, and trade-offs to technical and non-technical audiences
Requirements:
- 6+ years of product management experience, with proven experience shipping LLM/GenAI or ML-powered products to production
- Working knowledge of model evaluation, LLMOps and observability, prompt and agent design, and retrieval-augmented generation (RAG)
- Hands-on familiarity with the modern AI product stack, including LLM evaluation and observability platforms (Langfuse, LangSmith, Helicone), orchestration and agent frameworks (such as LangChain), vector databases and retrieval tooling, and experiment-tracking tools (such as MLflow)
- Comfort using Python and SQL
- Strong cross-functional leadership and sound judgment on AI risk and safety
- A Bachelor's degree in a technical or quantitative discipline
- Applicants must be authorized to work in the United States without the need for sponsorship now or in the future
Benefits:
- Eligibility for incentive awards based on both individual and business performance
- Comprehensive range of benefits

















