Technical Program Manager – Red Team Ops Lead
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Technical Program Manager leading delivery operations for Red Team in empathetic AI company. Ensuring reliable performance and quality for advanced AI systems in a collaborative environment.
Responsibilities:
- Own Red Team Delivery Operations (Core)
- Run end-to-end delivery for red team engagements across multiple customers/models: project kickoff → scoping → execution → QA → final reporting
- Define milestones, timelines, and SLAs; track progress and manage risk.
- Build repeatable operating rhythms: standups, weekly planning, retros, and incident response.
- Build Scalable Workflows & Processes
- Create scalable workflows for: task intake and prioritization expert assignment and capacity planning review/approval gates and escalation paths version tracking and auditability (model versions, prompt variants, test suites)
- Standardize definitions of done and ensure deliverables are consistent and customer-ready.
- Drive QA System Design (with QA Lead)
- Partner with QA to implement: sampling strategies and review tiers (peer review → QA → escalation) defect taxonomy and severity calibration processes gold set creation + drift monitoring
- Track quality metrics and continuously improve signal-to-noise.
- Tooling & Pipeline Ownership (Requirements + Adoption)
- Translate operational needs into actionable product requirements for internal tooling: work queues, review interfaces, audit trails tagging taxonomies and attack libraries reporting automation and reproducibility tooling dashboards for throughput and quality
- Coordinate across Engineering/Product to launch improvements and drive adoption.
- Metrics & Performance Management
- Own dashboards and reporting for delivery performance: throughput per expert/day by task type on-time delivery %, cycle time QA defect rate and agreement rates “actionability” metrics (e.g., customer acceptance or fix rate)
- Identify bottlenecks and implement process improvements.
- Customer Execution Support (as needed)
- Partner with customer-facing teams to: scope engagements and set expectations ensure deliverables map to customer priorities present results and operational summaries Translate ambiguous customer needs into clear execution plans.
Requirements:
- 5+ years experience in technical program management, operations program management, or delivery operations roles.
- Proven ability to run complex programs involving both technical systems and human execution (e.g., evals, annotation, trust & safety ops, QA, vendor ops, or platform ops).
- Strong process design skills: you can build workflows, SOPs, and operating cadences that scale.
- Comfortable partnering with engineering teams on tooling requirements and delivery.
- Excellent written communication: clear specs, crisp status updates, and structured reporting.
Similar Jobs
Technical Product Owner – iGaming Marketing
Technical Product Owner leading development of iGaming marketing products at White Hat Gaming. Collaborating with teams to enhance Casino and Sportsbook integrations while managing technical backlogs.
Technical Product Manager
Technical Product Manager leading product strategy for a federal initiative in a fully remote setting. Collaborating with engineers and stakeholders to deliver impactful government services.
Technical Product Manager
Technical Product Manager driving product evolution and building novel tools for researchers at Anara. Working closely with teams to shape the future of scientific discovery with AI.
TPM – SDL, PGW, SDLA, HSS, AUSF_UDM, HSM, MNP, EIR, One-NDS
Technical Project Manager at Capgemini Engineering focusing on SW Telco solution delivery. Managing project coordination, status reporting, and customer interactions in a collaborative team environment.
Technical Product Owner – Delivery Manager
Lead planning, execution, and delivery of technical initiatives at Sand Cherry Associates. Manage product backlogs and drive Agile processes in a remote setting.
Technical Product Owner – SAP Finance
Technical Product Owner focusing on the development of SAP S/4HANA Finance platform in a growing digital mobility company. Full responsibility for sustainable process optimization and automation within the finance system.
Staff Technical Product Manager – Secure End User Endpoint Experience
Staff Technical Product Manager overseeing secure, user-focused endpoint solutions at GE HealthCare. Managing product strategy, cross-functional teams, and ensuring compliance and productivity across global operations.
Technical Product Owner
Technical Product Owner aligning business goals with technical execution at Libra Solutions. Managing product backlog and leading Agile software delivery processes with strong technical expertise.
Technical Product Owner, VoIP Hardware
Technical Product Owner for VoIP hardware clients driving development-ready requirements. Analyzing user scenarios and collaborating with C++ developers on SIP applications.
Technical Product Owner
Technical Product Owner driving VoIP application development for an international tech company. Collaborating on SIP Client Applications and designing feature requirements for real-time communications.
Principal TPM – PBM Benefit Data Integrations
Principal TPM managing complex PBM benefit data integrations for healthcare tech company Prescryptive Health. Overseeing program execution and ensuring data quality across various platforms.
Principal Technical Product Manager – Platform Services
Principal Technical Product Manager at Prescryptive leading software engineering projects to enhance healthcare technology solutions. Collaborating across teams and strategies for continuous improvement.
Technical Product Manager
Technical Product Manager at Apiphani shaping AI-driven automation solutions. Engaging with customers and engineering to define product vision, features, and strategy.
Senior Technical Product Manager – Platform, Integrations
Senior Technical Product Manager responsible for platform integrations and APIs at Virtuous, enhancing relationships with nonprofits through innovative technology solutions.
Product SME – Trade Promotion Management
Product SME for Trade Promotion Management at Unilever guiding global market processes. Collaborating with teams to support deployment, enhance products, and drive business change.
Senior Technical Product Manager
Senior Technical Product Manager at Basis leading programmatic buying innovations. Collaborating on technical solutions that enhance the digital media operations ecosystem.
Staff Technical Product Manager
Staff Technical Product Manager leading platform capabilities at Vannevar, a defense tech company building AI to deter adversaries. Driving structural coherence across engineering organizations.
Technical Program Manager – TPM
Technical Program Manager leveraging data orchestration and system design to optimize financial services for SMBs. Leading mission-critical initiatives at R2 with a focus on scalability.
Technical Product Manager
Technical Product Manager leading product development for clinical trial solutions that improve patient outcomes. Collaborating with technical teams and stakeholders to drive innovative, data‑driven products.
Technical Product Manager
Lead Technical Product Manager role within Product Management at Foley. Focus on complex systems, integrations, and platform modernization for cloud-based architecture.