Software Quality Operations Specialist
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Software Quality Operations Specialist improving Waymo’s autonomous driving safety through ML and Gen-AI tools. Developing quality controls, triage strategies, and operational SOPs for scalable autonomous vehicle deployment.
Responsibilities:
- Partner with Engineering to design, test, and deploy Machine Learning and Generative AI models and tools
- Use AI-powered insights and traditional triage signals to identify emerging on-road issue trends, risk scenarios, and edge cases
- Develop and refine data-driven issue discovery and monitoring strategies
- Define and document policies, guidelines, and Standard Operating Procedures integrating AI tools into vendor workflows
- Design and implement quality control processes for human- and AI-generated outputs
- Perform meta-quality checks and validate vendor work
- Provide feedback to improve human and model performance
- Serve as the Software Quality Operations subject matter expert for stakeholders, program leads, and vendor teams
- Create and update technical policies, guidelines, and SOPs for new scopes, platforms, and driving signals
- Provide technical leadership and consultation to improve workflows and quality
- Identify and escalate tooling issues, provide technical requirements to Engineering, and drive user testing for new tooling features
Requirements:
- BS/BA degree or 4 years of relevant work experience in AV Software Quality Operations
- Increased competency in supporting all phases of the machine learning development lifecycle, from data preparation and training to validation, deployment, and continuous monitoring
- Experience with ML testing and validation, including dataset quality assurance, bias detection, edge-case scenario testing, and performance evaluation using statistical metrics
- Ability to quickly learn and implement new concepts and utilize proprietary tools
- Strong understanding of driving rules and regulations
- Ability to provide occasional on-call availability for evenings, weekends, and holidays
- Flexibility to attend meetings outside standard hours to collaborate with the global team
- Ability to work in a fast-paced, high-stress environment while maintaining good judgment
- Excellent communication and interpersonal skills
- Preferred: experience working with offshore teams or multiple local operations hubs
- Preferred: basic SQL querying
- Preferred: competency in LLM/transformer models and/or ML for robotics
Benefits:
- Health, dental, vision, life, disability insurance
- Retirement Benefits: 401(k) with company match
- Paid Time Off: 20 days of vacation per year, accruing at a rate of 6.15 hours per pay period for the first five years of employment
- Sick Time: 40 hours/year (statutory, where applicable); 5 days/event (discretionary)
- Maternity Leave (Short-Term Disability + Baby Bonding): 28-30 weeks
- Baby Bonding Leave: 18 weeks
- 13 paid holidays per year
- Discretionary annual bonus program
- Equity incentive plan
- Generous Company benefits program
Similar Jobs
Manufacturing Operations Reviewer
Manufacturing professionals auditing AI-generated work products for Mercor. Reviewing realism, technical accuracy, grading defensibility, and practitioner usability for frontier-model training.
Learning Operations Assistant
Assistente de Learning Operations apoiando programas de desenvolvimento e educação corporativa da Gestão Inovada. Gerenciando plataformas, conteúdos, participantes, indicadores e suporte operacional aos clientes.
Director, Capital Markets Operations
Director leading HECM capital markets, securitizations, loan sales, and remediation. Supporting Onity Group’s mortgage servicing and origination solutions while managing investor and regulatory requirements.
CRM, Operations Analyst
CRM and Operations Analyst managing Zoho CRM, sales reporting, and deal processes. Supporting brightfin’s AI-powered IT financial management platform as sales operations scales.
Fraud Operations Manager
Fraud Operations Manager building Polymarket’s fraud operations for the world’s largest prediction market platform. Managing analysts, BPO partners, workflows, SLAs, and fraud investigations.
Senior Payroll Operations Analyst
Senior payroll analyst owning multi-state payroll, tax, equity, and HRIS operations at Midi Health, a women’s healthcare company. Supporting employees and cross-functional Finance, HR, Legal, and People teams.
Money Movement Operations Analyst
Money Movement Operations Analyst supporting ACH, wires, checks, and payment operations at Peak Credit Union. Researching transactions, maintaining controls, and escalating high-risk exceptions remotely.
Demand Operations Administrator
Demand Operations Administrator managing Salesforce, Marketo, and revenue technology for Hyland’s enterprise content platform. Supporting demand workflows, troubleshooting, documentation, and operational governance.
Catalog & Content Operations Lead
Catalog operations lead scaling Fresh Prints’ custom apparel ecommerce catalog. Building publishing, QA, and team systems for tens of thousands of product pages.
Admissions Operations Contractor – Undergraduate
Admissions operations contractor accelerating undergraduate application completion at Reach University. Managing applicant files, resolving documentation roadblocks, and supporting enrollment pipeline goals.
Publisher Operations Analyst
Publisher Operations Analyst resolving client and publisher issues across Yext’s local-business visibility platform. Using SQL, Snowflake, and scripts to improve operational health and publisher integrations.
LTL Operations Specialist
LTL Operations Specialist managing tracking, billing, claims, and carrier performance for ARS Logistics, a third-party logistics company. Remote contractor role supporting U.S. carriers and customers.
Administrative Operations Specialist
Administrative operations specialist coordinating logistics, facilities, compliance, and vendors for Outsource Access. Improving workflows through dashboards and AI-enabled process automation.
SVP, Operations
SVP of Operations scaling Flourish Health’s team-based youth mental healthcare nationally. Building operational systems across clinical, people, payer, compliance, and patient acquisition functions.
Operations Associate
Operations Associate managing fraud, fulfillment, shipping, and order operations for Nutrafol’s clinically tested hair wellness products. Coordinating with 3PLs and internal teams across DTC, B2B, and Retail channels.
Senior Partner Operations Manager
EMEA Partner Operations Manager optimizing onboarding, deal registration, and revenue reporting for Horizon3’s autonomous cybersecurity platform. Improving partner adoption across Europe, the Middle East, and Africa.
Operations Advisor
Operations Advisor shaping product strategy and operational solutions for Evernorth Health Services’ pharmacy clients. Managing escalated issues, projects, sales consultation, and cross-functional improvements.
Operations Specialist, Fluent in English, Portuguese
Operations Specialist processing safety and pharmacovigilance data for IQVIA’s life sciences and healthcare services. Managing adverse-event records, coding, narratives, and regulatory-compliant delivery.
Patient Services Representative – Practice Operations
Patient Services Representative handling patient billing calls and self-pay collections for University of Maryland Faculty Physicians. Investigating accounts, resolving patient questions, and conducting follow-up.
Working Student, Sales Operations
Werkstudent Sales Operations bei Bikeleasing, Anbieter leasingfinanzierter Diensträder und Mobilitätslösungen. Pflege von HubSpot-CRM-Daten, SharePoint-Inhalten, Reports und Sales-Prozessunterlagen.