Senior Software Development Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior backend engineer building evaluation, tracing, and observability infrastructure for Zillow’s AI assistants. Improving trustworthy AI experiences for the U.S. real estate platform.
Responsibilities:
- Design, build, and scale evaluation frameworks for Zillow’s agentic AI experiences
- Build tracing, observability, and quality measurement systems for production AI agents
- Create platform infrastructure enabling domain teams across Zillow to build on the Evals platform without bottlenecks
- Partner with applied scientists and machine learning engineers to integrate new AI evaluation capabilities into production systems
- Evolve how Zillow measures AI quality, reliability, trustworthiness, and product impact
- Stay current with emerging agentic AI paradigms, evaluation techniques, and LLM tooling and translate them into platform innovation
- Support scaling, reliability, performance optimization, incident response, and cost management for the evaluation layer
- Apply first-principles thinking to ambiguous problems and iterate quickly on novel solutions
- Design, ship, and operate scalable production ML services
- Evaluate third-party AI platforms and make build-versus-buy decisions for platform infrastructure
- Collaborate across applied science, ML, product, design, and engineering
Requirements:
- 4+ years of backend engineering experience designing, shipping, and operating scalable production ML services
- Experience building platform infrastructure or developer-facing services consumed by multiple teams
- Experience with APIs, user experience, reliability, and internal customers
- Hands-on experience with ML Evals and observability frameworks such as Databricks MLflow, LangSmith, Braintrust, or Promptfoo
- Experience evaluating third-party AI platforms and making principled build-versus-buy decisions
- Fluency working across applied science, ML, product, design, and engineering
- Comfort with LLMs, agentic systems, and evaluation frameworks
- Familiarity with orchestration tools such as LangChain, LangGraph, or MCP
- Experience using AI-assisted development tools
- Strong ownership and a growth mindset
- Advanced degree in Computer Science, Machine Learning, or related field, or equivalent practical experience building products using frontier LLMs, multimodal models, or agent-based systems (preferred)
- Experience designing and operating evaluation pipelines, including offline batch evaluations, online scoring, cost/latency/signal tradeoffs, and connecting user signals to training data (preferred)
Benefits:
- Equity awards based on factors such as experience, performance and location
- Flexible distributed work model through Zillow's Cloud HQ
- Work from a physical location of choice
- Inclusive, innovative, and engaging culture
- Employees empowered to grow
- Equal employment opportunity
- Disability or special-needs accommodation
- Consideration of qualified applicants with arrest or conviction records in accordance with applicable state and local law
Similar Jobs
Senior Full-Stack Engineer – remote
Senior Full-Stack Engineer building scalable Go backend services and Vue frontend experiences for refurbed’s refurbished-products marketplace. Delivering high-performance, accessible features used by millions across Europe.
Software Engineer – Market Data
Senior software engineer designing scalable market-data services for Alpaca, a global brokerage infrastructure company. Building developer-first APIs and production systems for stocks, options, crypto, and foreign exchange data.
Lead Engineer, Concept Development
Lead engineer developing Electronic Warfare prototype systems for BAE Systems Digital Intelligence. Owning concept development from ideas through laboratory and field demonstrations, while leading engineers and suppliers.
Senior Software Engineer
Senior Software Engineer developing accessible digital products and services for Walmart, the world's biggest retailer. Supporting inclusive retail experiences and accessibility standards.
Senior Fullstack Engineer, Agentic Experience
Senior full-stack engineer designing governed AI-agent infrastructure for CreatorIQ, the creator-marketing operating system. Building React/TypeScript interfaces and Node.js/Python services for enterprise automation.
Lead Engineer – Observability Platform
Lead engineer scaling CVS Health’s observability platform for healthcare technology. Architecting OpenTelemetry pipelines for logs, metrics, and traces across cloud environments.
Senior Software Engineer – Java Cloud
Senior Java engineer building CVS Health’s AI-native Health100 backend platform. Designing APIs, distributed systems, and production releases across remote US teams.
Senior Engineer – Observability Platform
Senior Observability Platform Engineer building CVS Health’s large-scale telemetry platform for healthcare applications. Designing OpenTelemetry pipelines and backend services across cloud and on-prem environments.
Backend Software Engineer
Backend Engineer building scalable data models, APIs, integrations, and AI foundations for Dragonboat’s strategic product portfolio management platform. Owning architecture and data-driven systems for enterprise customers.
Analista Programador/a Senior Full-Stack
Senior Full-Stack Analyst Programmer building Java and Angular applications for The Whiteam Consulting. Supporting REST APIs, CI/CD pipelines, PostgreSQL, cloud environments and production operations.
Growth Engineer
Growth Engineer building e-commerce systems, AI-agent workflows, and experiments for The Cycle’s women’s health beverage brand. Owning Amazon, Shopify, analytics, acquisition, and retention.
Senior Databricks Engineer – Lead
Senior Azure Databricks Engineer building scalable data pipelines and analytics solutions for Blend, an AI and data services provider. Optimizing Spark workloads on Azure.
Senior Software Engineer – Python Full Stack Developer
Senior Software Engineer building scalable Python and TypeScript cloud applications for First American India’s title insurance technology platforms. Developing AWS microservices, React frontends, workflows, and AI-assisted engineering solutions.
Software Engineer – Internal Tools, HR Automation
Software Engineer building Salmon’s internal HR database and automation workflows. Developing Retool applications, PostgreSQL structures, and integrations for a Southeast Asian fintech company.
Full Stack Developer
Full Stack Developer building secure, scalable AWS cloud applications for Guidehouse, a global AI-led professional services firm. Supporting modernization, prototypes, and client solutions.
AI Product Engineer
AI Product Engineer developing trusted, production-ready AI capabilities for Green Mountain Technology, a parcel logistics management and advisory firm. Leading generative AI products, analytics experiences, and decision-support solutions.
Senior Full Stack Engineer – F# / ASP.NET Core / ReactJS
Senior Full Stack Engineer building Boardwise’s board-management software with F#, ASP.NET Core, and React. Owning features, architecture, integrations, and scalable product development.
Senior Full Stack Software Engineer
Senior engineer building AI-driven full-stack cloud software for InfiniteChoice’s experience marketplace. Owning architecture, development, testing, deployment, monitoring, and continuous improvement.
Senior Software Engineer
Senior Software Engineer leading scalable software development for Pearson VUE's OnVUE remote proctoring platform. Designing cloud-native distributed systems, mentoring engineers, and driving technical excellence.
Senior Full Stack Engineer, .NET/React
Senior full-stack engineer building AI-enhanced .NET and React applications for a commercial real estate technology client. Developing scalable web products with Azure, Python, and modern DevOps practices.