Red Teaming Expert – AI Safety, Execution, QA Tooling Support
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Red Teaming Expert focused on executing adversarial testing for AI safety. Partnering with Product/Engineering to enhance QA tooling and delivery pipelines.
Responsibilities:
- Execute advanced adversarial testing and produce high-quality, reproducible findings.
- Partner with Product/Engineering to improve the QA tooling and delivery pipeline.
- Design and run adversarial tests across multiple failure modes.
- Create realistic multi-turn scenarios and produce clear, reproducible findings.
- Participate in QA review cycles to improve consistency and signal.
- Help refine rubrics and evaluation standards over time.
- Collaborate with TPM + Engineering to build scalable quality systems.
- Identify bottlenecks and propose automation.
Requirements:
- 3+ years in AI red teaming / model evaluation / trust & safety / abuse testing / security testing / adversarial testing / content integrity / policy enforcement QA
- Strong ability to generate adversarial prompts and identify realistic failure modes.
- Excellent writing skills: crisp, structured, and audit-friendly documentation.
- Sound judgment around safety severity.
- Comfortable working cross-functionally with Product/Engineering.
- Experience red teaming LLMs, tool-using models, or agentic systems is preferred.
- Familiarity with: prompt injection, indirect injection attacks, data exfiltration, privacy testing, evaluation datasets, gold sets, benchmark design.
- Experience supporting QA systems at scale (review flows, IRR, sampling plans).
- Ability to contribute technically to pipeline work: writing scripts, working with APIs, SQL, dashboards, or data tooling.
Benefits:
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Similar Jobs
Quality Assurance Engineer
Quality Assurance Engineer for testing software, ensuring quality for product development team and validating releases. Focus on bug detection and process improvement in a remote setup.
Salesforce QA Analyst – Environmental Health
Salesforce QA Analyst ensuring environmental health applications function correctly while supporting public health initiatives at Flourish and Thrive Labs.
QA Automation Developer, Salesforce
QA Automation Developer enhancing Salesforce customizations for mortgage financing technology. Engaging in test automation, system testing, and regression testing within Salesforce applications.
Backend QA Engineer
Backend QA Engineer testing APIs and databases to ensure reliability and performance at Air Apps. Collaborate with engineering teams to maintain high-quality standards across infrastructure.
Backend QA Engineer
Backend QA Engineer ensuring reliability, performance, and scalability of backend systems at Air Apps. Collaborating on API, database, and service integrity testing.
Backend QA Engineer
Backend QA Engineer at Air Apps to ensure reliability, performance, and scalability of backend systems along with testing APIs and databases.
Business Analyst, Tester
Test Engineer providing expertise in business process and system analysis and design at GDIT. Collaborating with teams to enhance DevSecOps processes and ensure testing compliance.
Director, Compliance – Quality Assurance
Director of Compliance & Quality Assurance responsible for upholding quality standards in telehealth. Leading compliance initiatives at a remote mental healthcare provider to ensure safety and regulatory adherence.
Quality Assurance Analyst
ISSS Quality Assurance Analyst ensuring software accurately supports regulatory workflows in international education. Collaborating with product and engineering teams on quality assurance and testing processes.
Environmental Health System QA Analyst – Public Health
Environmental Health QA Analyst ensuring environmental health apps work effectively for public health agencies. Developing test plans and collaborating with tech teams to enhance system usability.
Quality Assurance Team Lead
QA Lead guiding a team of Service Quality Engineers at Mark43. Partnering with Engineering to define testing strategies and improve product quality.
Quality Assurance Engineer
QA Engineer focusing on Android testing at Reveal, a startup revolutionizing field operations with software tools. Ensuring quality across mobile and cloud systems in a dynamic environment.
QA Analyst
QA role executing manual tests in web, mobile apps and APIs for international team. Requires collaboration with development teams and participation in agile rituals.
QA Engineer
QA Automation Engineer at Proofpoint developing automated tests using Python and ensuring software quality. Collaborating with developers and QA professionals to enhance testing processes.
QA Team Lead
QA Team Lead responsible for testing and managing QA Engineers at StorMagic. Focused on enhancing quality standards for HCI products through leadership and technical expertise.
Senior Software Quality Assurance Engineer
Senior Software Quality Assurance Engineer building automation systems at Insider One. Collaborating with teams to ensure high-quality products throughout the development lifecycle.
Product Quality Engineer
Product Quality Engineer enhancing software quality for Double's all-in-one bookkeeping tool. Collaborating with QA engineers on testing strategies and ensuring high-quality user experiences.
Product Quality Engineer
Product Quality Engineer ensuring high-quality user experiences for Double's all-in-one tool. Collaborate with QA Engineers to deliver rapid software deployment.
Senior Quality Assurance Specialist
Quality Assurance Specialist at Valon ensuring compliance and performance of contact center operations. Conducting quality reviews and mentoring staff to improve customer interactions.
Software Quality Assurance Engineer
Software Quality Assurance Engineer for Insider One, a leader in marketing and customer engagement solutions. Join a diverse team focusing on innovative testing processes and quality control.