Staff Data Scientist
Posted 1ds ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff Data Scientist building conversational AI voice and SMS agents for Angi’s home-services marketplace. Improving agent behavior, evaluation, experimentation, and predictive models.
Responsibilities:
- Lead improvements to agent conversation, qualification, and booking through conversation design, prompting, and campaign logic
- Build evaluation systems using automated checks over conversation traces, simulated conversations, and model-based evaluation
- Establish experiment design frameworks and practices for product decisions
- Analyze real conversations to identify agent successes and failure modes
- Develop predictive models for qualification, appointment quality, homeowner engagement, and channel and timing selection
- Deploy models to production with monitoring and testing
- Collaborate with engineers, product managers, designers, and operations partners from ideation through deployment
- Explore innovative approaches to complex business problems
- Mentor junior team members and promote technical excellence and knowledge sharing
Requirements:
- Master's or Ph.D. in a quantitative field (e.g., Computer Science, Statistics, Mathematics, or related fields), or equivalent practical experience
- 6+ years of experience in data science and machine learning
- Experience with systems whose outputs are non-deterministic, such as LLM applications, conversational agents, or ranking and recommendation systems
- Experience building ways to measure system quality
- Expertise in statistical thinking and experiment design, including power and sample size, sequential and non-inferiority designs, and correlated data
- Experience analyzing and categorizing large volumes of real customer interactions
- Proven track record of taking impactful work into production environments and maintaining it
- Proficiency in SQL and Python
- Experience with cloud ML solutions
- Excellent communication skills with the ability to convey complex technical concepts to non-technical stakeholders
- Preferred: Experience with LLM applications in production, including prompting, agent design, or evaluation tooling
- Preferred: Experience with voice or telephony systems, such as streaming speech recognition, turn taking, or call quality measurement
- Preferred: Experience with workflow orchestration for long-running processes
- Preferred: Background in home services, field service, or another operations-heavy marketplace
Benefits:
- Competitive year end performance bonus
- Equity package
- Full medical, dental, vision package
- Flexible vacation policy
- Pet discount plans
- Retirement plan with company match (401K)



















