Senior QA Engineer – AI/LLM
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior QA Engineer responsible for testing LLM-based products in leading blockchain ecosystem. Involves in design, automation, and quality assurance for AI applications.
Responsibilities:
- Design and execute end-to-end testing strategies for LLM-based consumer products (functionality, data, model behavior)
- Verify the correctness, consistency, stability, and safety of LLM outputs
- Regression testing and risk assessment for model updates / prompt iterations / data changes
- Design and develop automated testing and QA tools to improve testing efficiency and coverage
- Use or introduce AI technologies (such as LLM) to enhance test design, defect analysis, and test case generation capabilities
Requirements:
- Bachelor or Master in computer science, computer engineering or related area.
- At least 3+ years of software QA engineering experiences.
- Full cycle testing with test planning and both manual/automation execution.
- Solid Java coding skills, and experienced in automation or QA tools development.
- Good understanding in AI applications and LLM prompt engineering techniques. Experiences in LLM development or eval is a plus.
- Excellent self-driven and ownership with good deliverables.
- Eager to learn, be curious about AI and new technologies of LLM.
- Good communication and collaboration skills.
Benefits:
- Competitive salary and company benefits
- Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
Similar Jobs
Doctor QA Specialist
Doctor QA Specialist ensuring quality patient communication for telehealth brands. Focused on quality assurance, compliance, and communication excellence across provider messaging.
Property Claims Quality Assurance Intern
Claims Quality Intern at California Fair Plan conducting research and vendor selection for claims review software. Collaborating with departments to enhance efficiency and accuracy in claims auditing.
Property Claims Quality Assurance Supervisor
Claims Quality Assurance Supervisor leading QA teams for property claims accuracy and compliance. Overseeing communications with the Department of Insurance and supporting Claims Examiners.
QA Analyst
QA Analyst ensuring software quality for innovative banking solutions at Stefanini. Managing testing processes and supervising external providers to uphold standards and documentation.
Quality Assurance Analyst – AI Data Annotation
QA Analyst responsible for quality auditing of AI/ML data annotation at Expedock. Collaborating with teams to improve data accuracy and provide feedback to annotators.
QA Engineer – Manual and Automation
Senior Quality Engineer responsible for designing automated test coverage for integration workflows. This role requires strong experience in Playwright and significant QA involvement in the healthcare sector.
Junior QA Engineer
Junior QA Engineer supporting testing of mobile applications for Virtusan. Handling functional, regression, and usability testing for iOS and Android devices.
Senior Supplier Quality Engineer
Supplier Quality Engineer responsible for overseeing supplier performance and compliance. Analyzing processes, ensuring quality standards, and collaborating with internal and external stakeholders.
QA Engineer
Manual QA Engineer ensuring product stability for a fintech SaaS company. Collaborating on product testing across frontend and backend systems to enhance quality.
Quality Engineering Technical Lead
Technical Lead in Quality Engineering, overseeing test strategy and automation in a global game services provider. Collaborate with teams to ensure high-quality standards across platforms.
Pentester
Pentester simulating attacks to identify vulnerabilities across networks and cloud infrastructure at Cyber Defence. Collaborating with teams to enhance client resilience and compliance.
Web QA Engineer
Web QA Engineer ensuring quality of a web-based photo editing product combining frontend and backend technologies. Validate UI and APIs with a focus on automation and efficiency.
Mobile Tester, iOS
Tester de aplicaciones móviles en Capgemini, desarrollando y ejecutando planes de prueba para sistemas Web/Digital. Validando integraciones y realizando pruebas transaccionales en plataformas iOS y Android.
Senior Quality Assurance Engineer
Senior QA Engineer responsible for QA processes and automation in IT projects for a fast-growing company. Collaborating with technical teams to improve product quality in various applications.
Quality Assurance Analyst – Co-op
QA Analyst Co-op for Real Estate Webmasters focused on software testing and product quality. Collaborating with a product team to ensure high standards in web applications.
Global Quality Assurance – Work-Study
Quality Assurance Intern for UPSA, participating in Global Quality activities and audits. Supporting compliance and documentation processes in the pharmaceutical field.
Quality Assurance Analyst
QA Analyst supporting Case Management Modernization Program at GDIT. Ensuring quality assurance for cloud-based data solutions across US federal courts with compliance testing.
Senior Quality Engineer
Sr. Quality Engineer I responsible for developing test automation frameworks at TrueML, a fintech company enhancing customer experiences for distressed borrowers.
Automation Tester
Automation Tester developing automated test scripts at Mind Computing. Ensuring software quality and functionality through analysis, execution, and collaboration.
Functional Tester
Functional Tester ensuring software quality and defect-free applications. Collaborating closely with developers and QA analysts, optimizing testing processes with latest tools and techniques.