Lead QA Engineer, Artificial Intelligence
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
QA Engineer for testing and automating AI/ML pipelines at Global Payments. Collaborating with engineers and data scientists to ensure quality in AI solutions.
Responsibilities:
- Develop and implement QA strategies tailored for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures.
- Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift).
- Collaborate with AI engineers, data scientists, and product teams to define success criteria, acceptance standards, and performance metrics.
- Validate model outputs and system behaviors against business and ethical guidelines.
- Perform regression, integration, stress, and adversarial testing of AI models and systems.
- Identify, log, and track bugs and anomalies, ensuring timely resolutions.
- Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations).
- Ensure compliance with internal AI governance standards, responsible AI principles, and regulatory requirements.
- Contribute to building automated AI testing frameworks, pipelines, and synthetic data generation systems.
- Document testing procedures, results, and quality assessments clearly and effectively.
Requirements:
- Bachelor’s degree in Computer Science, Engineering, or a related field.
- Minimum 6 years of experience in quality assurance, specifically testing AI/ML applications.
- Hands-on skills with Python and relevant AI/QA libraries (Pytest, Unittest, Great Expectations, MLflow, Deepchecks, etc.).
- Familiarity with machine learning frameworks (TensorFlow, PyTorch, or scikit-learn).
- Experience with test automation tools and frameworks.
- Knowledge of CI/CD tools (Jenkins, GitLab CI, or similar).
- Experience with containerization technologies like Docker and orchestration systems like Kubernetes.
- Familiarity with version control systems like Git.
- Strong understanding of software testing methodologies and best practices.
- Excellent analytical and problem-solving skills.
- Excellent communication and collaboration skills.
Benefits:
- Health insurance
- Retirement plans
- Paid time off
- Flexible work arrangements
- Professional development
Similar Jobs
Senior Test Analyst
Testing Analyst in a Brazilian technology group, focusing on software testing and quality assurance. Engaging in functional tests and supporting internal PLM system calls.
Quality Assurance Engineer
Quality Assurance Engineer for testing software, ensuring quality for product development team and validating releases. Focus on bug detection and process improvement in a remote setup.
Salesforce QA Analyst – Environmental Health
Salesforce QA Analyst ensuring environmental health applications function correctly while supporting public health initiatives at Flourish and Thrive Labs.
QA Automation Developer, Salesforce
QA Automation Developer enhancing Salesforce customizations for mortgage financing technology. Engaging in test automation, system testing, and regression testing within Salesforce applications.
Backend QA Engineer
Backend QA Engineer testing APIs and databases to ensure reliability and performance at Air Apps. Collaborate with engineering teams to maintain high-quality standards across infrastructure.
Backend QA Engineer
Backend QA Engineer ensuring reliability, performance, and scalability of backend systems at Air Apps. Collaborating on API, database, and service integrity testing.
Backend QA Engineer
Backend QA Engineer at Air Apps to ensure reliability, performance, and scalability of backend systems along with testing APIs and databases.
Business Analyst, Tester
Test Engineer providing expertise in business process and system analysis and design at GDIT. Collaborating with teams to enhance DevSecOps processes and ensure testing compliance.
Director, Compliance – Quality Assurance
Director of Compliance & Quality Assurance responsible for upholding quality standards in telehealth. Leading compliance initiatives at a remote mental healthcare provider to ensure safety and regulatory adherence.
Quality Assurance Analyst
ISSS Quality Assurance Analyst ensuring software accurately supports regulatory workflows in international education. Collaborating with product and engineering teams on quality assurance and testing processes.
Environmental Health System QA Analyst – Public Health
Environmental Health QA Analyst ensuring environmental health apps work effectively for public health agencies. Developing test plans and collaborating with tech teams to enhance system usability.
Quality Assurance Team Lead
QA Lead guiding a team of Service Quality Engineers at Mark43. Partnering with Engineering to define testing strategies and improve product quality.
Quality Assurance Engineer
QA Engineer focusing on Android testing at Reveal, a startup revolutionizing field operations with software tools. Ensuring quality across mobile and cloud systems in a dynamic environment.
QA Analyst
QA role executing manual tests in web, mobile apps and APIs for international team. Requires collaboration with development teams and participation in agile rituals.
QA Engineer
QA Automation Engineer at Proofpoint developing automated tests using Python and ensuring software quality. Collaborating with developers and QA professionals to enhance testing processes.
QA Team Lead
QA Team Lead responsible for testing and managing QA Engineers at StorMagic. Focused on enhancing quality standards for HCI products through leadership and technical expertise.
Senior Software Quality Assurance Engineer
Senior Software Quality Assurance Engineer building automation systems at Insider One. Collaborating with teams to ensure high-quality products throughout the development lifecycle.
Product Quality Engineer
Product Quality Engineer enhancing software quality for Double's all-in-one bookkeeping tool. Collaborating with QA engineers on testing strategies and ensuring high-quality user experiences.
Product Quality Engineer
Product Quality Engineer ensuring high-quality user experiences for Double's all-in-one tool. Collaborate with QA Engineers to deliver rapid software deployment.
Senior Quality Assurance Specialist
Quality Assurance Specialist at Valon ensuring compliance and performance of contact center operations. Conducting quality reviews and mentoring staff to improve customer interactions.