Staff Software Engineer – Tech Lead
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Technical Lead developing AI-driven platform at OpenLoop. Responsible for system architecture and hands-on integration of AI systems.
Responsibilities:
- Own System Architecture: Design and evolve distributed systems on GCP (Cloud Run, Pub/Sub, BigQuery), making final decisions on service boundaries, data models, and technology trade-offs across Go, Python, and TypeScript.
- AI & LLM Strategy: Lead hands-on integration of AI systems, including open-source LLMs, embeddings, and speech models. Define prompt optimization, evaluation strategies, and safety practices using tools like LangFuse.
- Operational Excellence: Champion observability, reliability, and scale. Oversee event-driven ingestion and automated QA pipelines for call transcripts and healthcare data (FHIR / Medplum).
- Delivery & Execution: Contribute code to critical paths while leading major technical initiatives. Identify gaps, unblock teams, and drive projects to completion.
- Cross-Functional Leadership: Translate complex technical constraints into clear options and trade-offs for Product, Design, and Clinical Operations.
Requirements:
- 8+ years of software engineering experience, with 2+ years leading projects or serving as a Tech Lead.
- Staff-level scope or equivalent technical impact.
- Strong LLM experience in production environments (hands-on required).
- ML background preferred, especially applied machine learning or AI infrastructure.
- Expert-level proficiency in Go, Python, or TypeScript/Node, with the ability to review code across the stack.
- Deep experience with distributed systems, containerized deployments (Docker, Kubernetes, Cloud Run), and event-driven architectures.
- Experience hosting or integrating open-source models (e.g., vLLM, Ollama), with a strong understanding of RAG architectures.
- Background in regulated environments (HIPAA, SOC 2) or healthcare data standards (FHIR, HL7).
- Strong written and verbal communication skills, including writing RFCs and explaining technical strategy to non-technical stakeholders.
Benefits:
- Medical, Dental, and Vision plans
- Flexible Spending/Health Savings Accounts
- Flexible PTO
- 401(k) + Company Match
- Life Insurance, Pet insurance, and more


















