Software Quality Assurance Analyst
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Software Quality Assurance Analyst validating LLM-powered conversational flows for Blip, Brazil’s conversational intelligence and messaging company. Testing APIs, integrations, generative models, and AI user experiences.
Responsibilities:
- Analyze LLM behavior to design test scenarios that ensure the accuracy, consistency, and safety of AI responses.
- Execute functional and automated tests on conversational flows and APIs, ensuring delivery stability for clients.
- Establish validation routines for generative models, mitigating hallucinations and ensuring alignment with business contexts.
- Identify integration anomalies and report detailed issues, collaborating with engineers to expedite fixes and improvements.
- Evaluate the usability and response times of AI-powered journeys to support a seamless, frictionless user experience.
- Work on the Professional Services team, collaborating with engineers and designers to validate LLM-powered conversational flows for enterprise clients.
Requirements:
- Hands-on experience creating and executing functional, exploratory, and regression tests for complex software workflows.
- Practical experience with test automation using industry-standard frameworks such as Cypress or Robot Framework for continuous delivery pipelines.
- Ability to translate expected AI and LLM behavior into rigorous test scenarios to ensure safe and accurate interactions.
- Experience testing RESTful APIs with tools such as Postman, validating integrations and data traffic.
- Proficiency with generative AI and modern tools such as GitHub Copilot to optimize script creation and accelerate troubleshooting.
- Practical ability to work with cloud environments and query data in relational and non-relational databases.
- Experience working in Agile environments, maintaining strategic communication and technical alignment with multiple stakeholders.
Benefits:
- No additional benefits, perks, or compensation are specified in the posting.
Similar Jobs
Global Career Starter Program – Quality, Supplier Quality Assurance
Graduate trainee developing supplier quality assurance and supply-risk processes at MAHLE, a global automotive technology company. Supporting digital tools, cross-functional projects and international assignments.
Junior QA Specialist
Junior QA Specialist manually testing modern applications for established companies and startups. Focusing on API, acceptance, and end-to-end testing within Scrum teams.
Training and Quality Assurance Specialist
Training and Quality Assurance Specialist evaluating customer interactions for an educational services company. Delivering training, coaching, gap analysis, and quality improvements across teams.
Quality Assurance Manager
Quality Assurance Manager reviewing defined contribution retirement-plan testing and compliance work. Providing feedback, training, and process improvements for a national 401(k) administration firm.
Clerical Quality Assurance Coordinator – Case Prepper
Remote Case Prepper coordinating client reports, records, invoicing, and physician communications. Supporting AllMed’s clinical decision-making and utilization management solutions.
QA Analyst
Analista de QA automatizando testes web, mobile e API para a empresa brasileira de pagamentos TruckPag. Planejamento de testes, gestão de falhas e melhoria contínua da qualidade.
Quality Assurance Engineer
Quality Assurance Engineer owning end-to-end quality for ThriveCart’s e-commerce platform. Building Playwright automation, monitoring production health, and using AI-augmented testing workflows.
Senior Salesforce QA Engineer
Senior Salesforce QA Engineer testing Salesforce solutions for federal health programs and citizen services. Leading functional, integration, automation, security, accessibility, and release testing.
Senior Quality Assurance Engineer
Senior QA Engineer ensuring quality of web and mobile software for Slate’s affordable, customizable vehicles. Developing automated tests, frameworks, and quality-centric engineering practices.
Senior Compliance and Quality Assurance Consultant
Senior Qualified Person consultant leading GxP quality assurance, regulatory, auditing, QMS, and CAPA projects. ProPharma provides consulting solutions to biotech, medical-device, and pharmaceutical organizations.
Senior Quality Assurance Engineer
Senior QA Engineer automating Playwright/Python testing for Revenera’s cloud-based software monetization and analytics products. Validating APIs, UIs, data pipelines, and end-to-end workflows.
Claim Quality Assurance Supervisor – Material Damage
Claims QA Supervisor leading material damage, total loss, and salvage teams for specialty auto insurer Aspire General. Driving quality, compliance, coaching, and claims process improvement.
QA Engineer – Ultimate team
QA Engineer testing JetBrains IntelliJ IDEA Ultimate tools for JVM frameworks. Balancing exploratory testing, regression coverage, and automated test development for enterprise developers.
Quality Assurance Engineer III
Quality Assurance Engineer III driving automated software testing for Avalon Healthcare Solutions’ diagnostic intelligence platform. Ensuring reliable healthcare products through QA strategy, testing, and mentoring.
Quality Assurance Coordinator
Quality Assurance Coordinator supporting Clario’s clinical research and healthcare technology quality compliance. Coordinating audits, inspections, documentation, schedules, and regulatory readiness.
Quality Assurance Analyst
Quality Assurance Analyst testing Ava Industries’ cloud-based EMR software. Validating clinic workflows, releases, defects, and user experience for Canadian healthcare providers.
Product Tester – eBooks, Books
Product tester evaluating Aquana Publishing books and eBooks from purchase through delivery. Providing genuine reader feedback on content and customer experience.
Quality Assurance Analyst – Medical Facility Surveys
Remote QA Analyst reviewing CMS healthcare survey documentation for HMS, a healthcare quality services provider. Analyzing surveyor performance, training needs, and process improvements.
Senior Financial Crimes Quality Assurance (QA) Analyst
Financial Crimes QA Sr. Analyst strengthening BSA/AML, Sanctions, and Fraud oversight. Improving quality reviews and governance at Pathward, a financial empowerment company.
Financial Crimes QA Analyst II
Financial Crimes QA Analyst II reviewing BSA/AML, sanctions, and fraud oversight for Pathward, a financial empowerment company. Challenging decisions and improving regulatory risk governance.