Senior Software Engineer, AI Platform
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Software Engineer building orchestration, evaluation, and guardrail infrastructure for Kinetic’s AI agents. Supporting technology-driven workers’ compensation solutions for employers and insurers.
Responsibilities:
- Build and operate Kinetic's agent orchestration layer, including model routing, tools, memory, permissions, and guardrails
- Ship prompts, tools, and model versions through CI/CD with cost and latency tracking and rollback capability
- Build MCP servers and tools providing secure agent access to Salesforce, Athena, and claims data
- Implement PHI and PII redaction and full audit logs
- Build evaluation harnesses and rollout gates using golden datasets before production release
- Build human-in-the-loop checkpoints for critical decisions
- Replatform or retire one-off AI scripts and workflows
- Set standards and review agent designs and code
- Mentor engineers building agents across Kinetic
- Evaluate when to use AI and when to buy versus build systems and components
- Write production code daily and set technical direction for agent infrastructure
- Partner with product and platform development teams
- Report to the Tech Lead - Data & AI
Requirements:
- Bachelor's degree in Computer Science or a related field
- 6+ years of software engineering experience
- 2+ years building LLM-powered systems in production
- Strong Python on serverless, with AWS preferred
- Experience with infrastructure as code and CI/CD
- Hands-on experience building multi-agent systems with CrewAI or other agent frameworks such as LangGraph, OpenAI Agents SDK, Google ADK, or AWS Bedrock AgentCore
- Experience with tool calling, structured outputs, RAG, and MCP
- Experience building evaluation and observability for LLM systems, including golden datasets, automated graders, and tracing
- Ability to explain probabilistic systems to business partners
- Candidates must reside within the US
- Existing authorization to work in the United States
- Successful completion of identity and background verification
- Nice-to-have: experience at an insurtech, MGA, carrier, healthcare, financial services, or other regulated industry
- Nice-to-have: experience handling sensitive data under HIPAA, SOC 2, or similar requirements
- Nice-to-have: experience with Salesforce, Athena, multi-model cost optimization, OpenTelemetry, startups, or high-growth environments
Benefits:
- Fully distributed, remote team across all continental US time zones
- Medical, dental, and vision insurance
- 20 vacation days per year
- 9 federal holidays off
- Parental Leave
- Pre-tax 401k contribution
- HSA with compatible health plans
- FREE: Health Advocate
- FREE: Telehealth Membership
- FREE: OneMedical Account
- Domestic travel for company offsites and team alignment
Similar Jobs
Founding AI Lead, Human Behavior Simulation
Founding AI Lead building human behavior simulation models for Populix, Indonesia’s market and policy research consultancy. Leading Singapore client deployments, research, and eventual local team scaling.
Staff AI Developer
Staff AI Developer leading scalable AI/ML architecture and production delivery at Robots and Pencils. Building reliable, secure systems for enterprise workflows and mentoring engineering teams.
Strategic Project Lead – AI Post-Training
Strategic Project Lead improving frontier AI models through high-quality training data at Appen. Owning client projects, evaluation workflows, quality standards, and AI data delivery.
Senior Data & AI Engineering Consultant
Senior consultant designing and delivering Azure and Microsoft Fabric data platforms for Interlink Cloud Advisors’ clients. Building governed, analytics-ready datasets for BI, analytics, and AI.
Senior Full Stack Engineer – AI Agentic
Senior Full-Stack AI Engineer building LLM-powered recruiting platforms for Inallmedia.com. Developing AI agents, Python services, and Salesforce/ATS integrations for global staffing clients.
AI Engineer – Freelance
AI Engineer building generative AI, LLM, and RAG solutions for HRM clients. Designing scalable platforms and supporting software delivery from analysis through deployment.
Staff AI Engineer
Staff AI Engineer designing reliable, secure and cost-efficient production agents for Cobalt’s pentesting platform. Setting agent architecture, evaluation, observability and engineering standards across teams.
Staff Software Engineer – AI
Staff Software Engineer building and deploying scalable AI/ML features for 8am’s SaaS platform. Developing Python, LLM, data infrastructure, and cloud deployment solutions for professional services.
Senior C# Developer, AI Experience
Remote senior C#/.NET developer building APIs and analyzing an enterprise data platform. Later-phase work includes LLM integration, RAG, and GenAI solutions.
Software Engineer – AI Systems, Go
Software Engineer building Go-based production AI systems and durable agent workflows for Stanbridge University. Designing reliable, observable, multi-provider AI infrastructure and backend services.
Working Student – AI Engineering
Working Student building Python AI applications, RAG workflows, and agent systems at Hamburg-based data and AI engineering company AgentixLake. Supporting evaluation, testing, deployment, and monitoring.
Staff Applied AI Engineer
Staff Applied AI Engineer owning AI portfolios and shipping agentic applications. Modernizing collectibles authentication, grading, vaulting, and trading through applied AI.
Staff Software Engineer – AI Platform
Staff Software Engineer building Aledade’s shared AI infrastructure for secure foundation-model access. Developing scalable model gateways, cloud integrations, observability, and self-service platform capabilities.
Divisional Artificial Intelligence Engineer III
AI platform engineer leading architecture, reliability, and adoption for shared LLM infrastructure. Building reusable orchestration, observability, and production services across products.
Forward Deployed AI Engineer
Forward Deployed AI Engineer deploying production AI solutions for Keyrus, an enterprise intelligence consultancy. Integrating APIs, cloud platforms, enterprise systems, and client workflows.
Staff Applied AI Engineer
Staff Applied AI Engineer owning business-domain AI portfolios at Collectors, a collectibles authentication, grading, and trading technology company. Building production agents and reusable application patterns.
AI Architect, Software Architect
Arquitecto de IA Generativa y software para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, soluciones empresariales y servicios de IA para clientes.
Java Software Architect, AI
Arquitecto Java y especialista en IA Generativa para knowmad mood, compañía de transformación digital. Diseñando arquitecturas, modernizando aplicaciones y asesorando a clientes en soluciones de IA.
Senior Libraries Engineer – AI, HPC
Senior Libraries Engineer developing GPU- and CPU-accelerated libraries for AI, image processing, and scientific computing at NVIDIA. Optimizing algorithms and leading library engineering projects.
AI Engineer, Forward Deployed
AI Engineer building production Claude agents, RAG pipelines, and MCP integrations for Collectiv’s enterprise analytics and AI consulting clients. Consulting directly with stakeholders from a fully remote U.S.-based role.