Mid-Level Systems Quality Analyst
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Analista QA garantindo a qualidade dos sistemas da IOB, empresa de soluções para pessoas e negócios. Testando agentes de IA, servidores MCP e APIs com automação e investigação técnica.
Responsibilities:
- Plan and execute testing strategies for AI agents, MCP servers, and APIs
- Perform functional, integration, regression, and performance testing
- Build and maintain automated unit, integration, and end-to-end tests
- Validate AI agent responses and behavior, including prompt scenarios, hallucinations, and edge cases
- Investigate bugs through to their root cause
- Propose or implement minor fixes directly in the code in collaboration with the development team
- Document test cases, evidence, and quality reports
- Collaborate with developers, AI engineers, and product managers throughout the development lifecycle
Requirements:
- Previous experience as a QA professional or Test Analyst, working with both manual and automated testing
- Ability to read and understand code, with the autonomy to propose or make minor adjustments and fixes
- Knowledge of Git version control
- Strong analytical thinking and technical curiosity to investigate the non-deterministic behavior commonly found in AI systems
- Experience testing LLM-based systems, AI agents, or chatbots
- Familiarity with the MCP (Model Context Protocol) or AI-powered tool integrations
- Experience with load and performance testing for APIs
- Knowledge of CI/CD, including GitHub Actions and GitLab CI
Benefits:
- 100% remote work
- Health insurance
- Dental insurance
- IOB Benefits Card
- Childcare assistance
- Life insurance
- Internet allowance
- Profit-sharing plan (PLR)
- Partnerships with educational institutions
- Access to an Assessment and Development Platform
- Training and professional development programs
- Continuous feedback culture
Similar Jobs
Senior Backup Analyst
Analista de Backup Sênior operando ambientes de backup, storage e infraestrutura empresarial. Resolução de problemas com Networker, Data Domain, VEEAM e ferramentas de monitoramento.
PMO & Portfolio Analyst
PMO analyst managing initiative intake, portfolio reporting, risks, and governance for Rithum’s commerce network. Supporting brands and retailers through data-driven program operations.
PMO – Portfolio Analyst
PMO analyst managing initiative intake, portfolio reporting, risks, and governance for Rithum’s commerce network. Supporting Brands Services leadership with prioritization and resourcing analysis.
Clinical Testing Automation Analyst
Clinical testing automation analyst developing UiPath test automation for Highmark healthcare applications. Supporting Epic workflows, quality assurance, and process improvement across U.S. remote locations.
Data Quality Analyst
Data Quality Analyst ensuring reliable data for Arrowhead Intermediaries’ reporting, analytics, and machine-learning applications. Building validation controls, investigating root causes, and communicating quality findings.
Senior Product Development Analyst
Senior Analyst developing and launching Property & Casualty insurance products for Martin & Company, an insurance advisory and consulting firm. Coordinating compliance, actuarial, filings, market research, and carrier initiatives.
Revenue Cycle System Analyst I
Revenue cycle systems analyst reviewing healthcare billing systems for Overlake medical center. Resolving application problems, maintaining system files, reporting findings, and training staff.
Analyst I, Certification
Certification Analyst investigating websites, products, and merchants for LegitScript, which makes internet and payment ecosystems safer. Reviewing compliance, identifying risks, and determining certification eligibility.
Reconciliation Analyst
Reconciliation Analyst reconciling clinical trial receivables, contracts, budgets, and financial study data. Supporting Sarah Cannon’s oncology research and accurate sponsor billing.
Behavioral Health Quality Analyst
Behavioral Health Quality Analyst reviewing coding audits for EXL, a data analytics and digital operations company. Identifying errors, mentoring auditors, and improving healthcare audit quality.
Treasury Analyst
Treasury Analyst supporting cash management, payments, reconciliations, and forecasting for CookUnity’s chef-powered meal delivery marketplace. Improving treasury controls and processes in a fast-growing environment.
Senior Analyst, Health Plan Analytics
Senior analyst building claims models and medical economics reporting for Hopscotch Primary Care. Turning healthcare data into insights that improve value-based care in rural communities.
Threat Response Analyst, Protective Services
Threat Response Analyst leading predictive protective intelligence and behavioral threat response for DoorDash's global delivery platform. Managing escalations, profiling individuals of concern, and briefing executive security decisions.
HRIS Analyst
HRIS Analyst administering and improving Workday HCM for Mission Produce, a global fresh produce company. Supporting HR systems, data integrity, and cross-functional stakeholders worldwide.
V&V Analyst
V&V Analyst validating data flows and algorithms across major advertising channels for Quartile’s AI-powered retail media optimization platform. Ensuring system integrity and continuous product improvement.
Implementation Analyst
Implementation Analyst configuring GovPilot’s Hedgerow SaaS platform for local governments. Managing customer onboarding, SQL reporting, data mapping, training, and go-live support.
Residential Solar Incentives Analyst
Residential solar incentives analyst processing state and federal applications, tracking revenue, and ensuring compliance. Supporting IGS Energy’s residential solar business through reporting and cross-functional operations.
Deal Desk Analyst
Deal Desk Analyst supporting pricing, contracts, and approvals for AlphaSense’s AI-driven market intelligence platform. Improving deal workflows, metrics, and cross-functional sales operations.
Clinical IT Quality Control Analyst
Clinical IT Quality Control Analyst validating software, processes, and data for Sarah Cannon Research Institute’s oncology clinical research programs. Ensuring GxP, 21 CFR Part 11, and FDA validation compliance.
Senior Contracts Analyst
Senior Contracts Analyst managing provider contracts, compliance, audits, and incentives for Prime Therapeutics, a pharmacy benefit manager. Analyzing pharmacy data and supporting regulated public-sector initiatives.