Staff Software Engineer, AI/ML Infrastructure
Posted 1hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home-services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Responsibilities:
- Build and evolve core AI platform capabilities for GenAI-powered applications
- Design, develop, and deploy scalable tools and infrastructure for applied scientists
- Support ML model training and serving systems, feature and data workflows, CI/CD, orchestration, deployment, and evaluation tooling
- Work hands-on across backend services, execution infrastructure, AI models, and tooling
- Evaluate next-generation AI infrastructure frameworks and tools
- Drive projects to completion with focus on business impact and measurable outcomes
- Set technical direction across AI/ML and AI evaluation platforms
- Partner with applied scientists, product engineering teams, senior engineers, and engineering leadership
- Define multi-quarter roadmaps and make build/buy/adopt decisions
- Ensure the platform scales with Thumbtack's AI ambitions
- Solve complex technical problems and stay current with advances in AI infrastructure
Requirements:
- 10+ years of professional software engineering experience
- Track record of technical leadership at staff level or equivalent scope
- Experience setting direction for systems spanning multiple teams and driving them through production
- 3+ years building AI/ML infrastructure in production
- Hands-on experience with LLM-powered systems in production
- Experience with LLM gateways or proxies, prompt and model lifecycle management, RAG or agentic architectures, and cost optimization for LLM workloads
- Experience building or operating AI evaluation systems
- Experience with offline evaluation pipelines, LLM-as-judge approaches and calibration against human judgment, regression testing, or A/B measurement of AI features
- Deep experience designing, building, and operating reliable distributed systems
- Production service ownership at meaningful scale
- On-call responsibility and incident leadership
- Demonstrated ability to use AI coding tools and validate, critique, and refine AI-generated output
Benefits:
- Equal opportunity workplace
- Reasonable accommodation for individuals with disabilities

















