Senior Software Engineer – AI Innovation
Posted 11hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Software Engineer building production AI agents for Worth AI’s fintech underwriting platform. Designing retrieval, evaluation, and MLOps systems for regulated financial decision-making.
Responsibilities:
- Design and ship multi-step agentic systems (planner/executor, tool-using, multi-agent, human-in-the-loop) that automate KYB, underwriting, case review, and risk monitoring workflows.
- Architect agent graphs in LangGraph or comparable frameworks with explicit state, durable execution, retries, and safe fallbacks.
- Build and harden the retrieval layer powering agents, including chunking strategies, hybrid search, reranking, and grounded citation across business filings, IRS records, bank data, and Worth’s SMB graph.
- Own the eval stack: golden sets, offline regression suites, LLM-as-judge, online A/B and shadow evals, and red-teaming for jailbreaks, prompt injection, and PII leakage.
- Wire agents into production systems via well-typed tools, MCP servers, and existing services.
- Drive production MLOps for agents: deployment, versioning, traffic shaping, cost/latency budgets, observability, and on-call playbooks for agent incidents.
- Partner with security, compliance, and legal to keep agents inside SOC 2, GDPR, CCPA, and fair-lending posture.
- Translate ambiguous product bets into concrete agent designs, prototypes, and shipped features.
- Mentor engineers across the organization on agent patterns, prompt engineering hygiene, eval discipline, and LLM failure modes.
- Stay ahead of new models, frameworks, and patterns and bring back what works in production.
- Collaborate with the Chief AI Officer, applied scientists, product, and platform teams.
- Meet success metrics for agent quality, production reliability, velocity, risk posture, and organization-wide adoption of engineering patterns and tools.
Requirements:
- 8+ years of professional software engineering experience, with at least 2 years building production LLM or agentic systems (not just notebooks or demos).
- Solid software engineering experience - front-end, APIs, async patterns, queues, databases, and the failure modes of distributed systems.
- Demonstrated ownership of major features or subsystems in production.
- Demonstrated experience mentoring junior engineers and raising team quality standards.
- Demonstrated experience with event-driven systems: enrichment, retries, dead-lettering, backpressure.
- Experience managing containerized applications in Kubernetes, EKS, ArgoCD, operators, Kustomize.
- Deep, hands-on experience with at least one modern agent framework (LangGraph strongly preferred) and a track record of shipping agents that actually run, fail gracefully, and recover.
- Real experience with evals — you’ve built golden sets, run offline and online evaluations, and used them to make ship/no-ship calls.
- Production MLOps fluency: you’ve deployed LLM workloads under real latency, cost, and reliability constraints, and you instrument what you ship.
- Strong proficiency in Python; comfortable in TypeScript / Node.js for integrating with Worth’s services.
- Clear, calibrated communicator - able to explain agent trade-offs to product, security, and customers without hand-waving.
- Operates with extreme ownership in ambiguous, fast-moving environments. Excited to work alongside a team that values “One Team”, “Extreme Ownership”, and “Create Raving Fans.”
Benefits:
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance
- Flexible Paid Time Off
- 9 paid Holidays
- Family Leave
- Remote
- Hybrid work (for Orlando Associates)
- Free Food & Snacks (Orlando)
- Wellness Resources


















