Senior Software Engineer, Agentic AI

Posted 1hrs ago

Employment Information

Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Senior Software Engineer building production agentic AI for Counterpart Health’s healthcare platform. Developing RAG pipelines, tool workflows, and trusted clinical software.

Responsibilities:

  • Build and maintain customer-facing agentic AI software from data ingestion through the user interface
  • Develop RAG pipelines for ingestion, ETL, storage, indexing, retrieval, and context assembly
  • Build agent workflows that call tools and application services with permissions, execution limits, and human review
  • Select models, storage, retrieval, and orchestration patterns based on product needs and measured results
  • Protect PHI and tenant boundaries across data, prompts, retrieval, tools, and outputs in a HIPAA-regulated environment
  • Use customer feedback and failure analysis to improve answers and tool execution
  • Measure and improve quality, reliability, latency, and cost
  • Learn and apply new tools and technologies to solve user problems while maintaining operable systems
  • Help define development practices, tests, and documentation
  • Collaborate with Product Managers and operational staff to define workflows, success criteria, and customer features
  • Work with engineers, data scientists, and healthcare professionals across data pipelines, backend services, model behavior, and user experience

Requirements:

  • Personally owned a production agentic system used by external customers
  • Ability to explain contributions across ingestion, ETL, storage, retrieval, tool-calling loop, inference, and UI integration
  • Experience using evaluations to improve a live system, including test data, failure categories, release criteria, and limits of automated or LLM-as-judge scoring
  • Senior software engineering experience with ability to write, test, debug, and operate application code behind an AI feature
  • Python and TypeScript or JavaScript experience are useful, or comparable experience in another production language
  • Experience with SQL, APIs, data pipelines, and cloud services such as GCP or AWS
  • Experience handling context-window limits, unsupported answers, retrieval failures, and incorrect tool calls
  • Healthcare or regulated-industry experience is a plus
  • Experience with LangGraph, Langfuse, pgvector, or OpenSearch is useful but not required
  • Production AI experience; demos, AI coding assistants, or internal tools alone do not meet the requirement

Benefits:

  • Competitive base salary
  • Equity opportunities
  • Performance-based bonus program
  • Regular compensation reviews
  • Comprehensive group medical coverage including hospitalization, outpatient care, optical services, and dental benefits
  • No-Meeting Fridays
  • Company holidays
  • Mental health resources
  • Generous annual leave policy
  • Remote-first culture and flexibility
  • Learning programs
  • Mentorship
  • Professional development funding
  • Regular performance feedback and reviews
  • Reimbursement for office setup expenses
  • Flexibility to work from home
  • Paid parental leave for all new parents