Senior Agentic AI Specialist
Posted 16hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Agentic AI Specialist working on agentic AI capabilities at Midwest Family Mutual Insurance. Collaborating with architects and developers to design, implement, and improve AI systems.
Responsibilities:
- Provide input into AI-related architecture decisions
- Design, build, and maintain agents
- Improve retrieval quality by working with chunking strategies and embeddings
- Help reduce incorrect or unsupported outputs through system design, testing, and monitoring
- Develop and maintain evaluation approaches to measure output quality
- Create and maintain prompts for different agents
- Support integration with internal systems and APIs
- Contribute to logging, tracing, and monitoring
- Work with configuration across agents, prompts, and models
- Stay current with new models and tools
Requirements:
- College degree or Programming Certification (preferred)
- 5+ years of equivalent work experience
- Experience building or working with AI/LLM-based systems in a production or near-production environment
- Strong understanding of agent-based patterns (ReAct, tool usage, etc.)
- Experience with retrieval-based systems (RAG), vector stores, or search pipelines
- Familiarity with evaluating non-deterministic system outputs
- Experience improving system quality through testing and iteration
- Strong software engineering skills required
- Experience with Python, TypeScript, or C# preferred
Benefits:
- Remote work environment following core hours 8AM-5PM Central Time
- Overtime may be required to meet project deadlines or monitor system processes
- Minimal travel will be required for the purpose of off-site software training and team meetings














