Senior AI Quality Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior AI Quality Engineer at Accelint focusing on the reliability of AI-powered applications in mission-critical environments. Involves bespoke testing frameworks, scenario validation, and cross-functional collaboration.
Responsibilities:
- Participate across the AI solution lifecycle from requirements and design through development, testing, and deployment
- Build and maintain systems that exercise agentic workflows against realistic scenarios, edge cases, and failure conditions
- Define contracts, validation, and explicit failure behavior at integration points
- Create shared libraries, reference harnesses, and validation utilities that teams can reuse
- Architect agentic systems so correctness, safety, and expected behavior are enforced by design
- Participate in solution design to identify likely failure patterns in agentic systems
- Define and implement cost-conscious evaluation strategies for AI-enabled systems
- Work with cross-functional program teams to translate customer and mission needs into criteria
- Communicate estimates, progress, and technical tradeoffs clearly to development leads and product owners
Requirements:
- 5+ years of professional software engineering experience
- Demonstrated experience building bespoke validation, evaluation, or testing frameworks for complex systems, using or expanding tools such as Playwright, pytest, k6, Guardrails AI, or similar frameworks
- Data validation, schema enforcement, and contract testing experience in distributed or service-oriented architectures
- Experience treating quality, reliability, and correctness as core design concerns
- Experience defining, interpreting, and acting on quality signals to assess system readiness
- Hands-on experience designing, building, and operating AI-powered systems, including agentic workflows or orchestrated LLM-based applications
- Solid understanding of Amazon Web Services and its native AI/ML services
- Practical experience integrating automation into CI/CD pipelines and delivering software in an iterative, agile environment
- Working knowledge of security best practices relevant to regulated or mission-critical contexts
- Proven ability to work effectively with cross-functional teams
Benefits:
- Paid Time Off
- Paid Company Holidays
- Medical, Dental & Vision Insurance
- Optional HSA and FSA
- Base and Voluntary Life Insurance
- Short Term & Long-Term Disability Insurance
- 401k Matching
- Employee Assistance Program
Similar Jobs
Analista QA
Analista QA responsible for designing, executing, and reporting on test cases for Falabella projects. Collaborating with clients and project leaders in a remote work environment.
Automation Tester
QA Consultant specializing in transitioning test automation framework from Leapwork to Playwright. Requires strong expertise in Playwright and software testing principles.
Claims Quality Assurance Director
Director of Claims Quality at Aspire General Insurance Company leading claims quality assurance programs and cross-functional collaborations. Driving performance improvements and regulatory compliance in a fully remote role.
Senior Test Analyst
Testing Analyst in a Brazilian technology group, focusing on software testing and quality assurance. Engaging in functional tests and supporting internal PLM system calls.
Quality Assurance Engineer
Quality Assurance Engineer for testing software, ensuring quality for product development team and validating releases. Focus on bug detection and process improvement in a remote setup.
Salesforce QA Analyst – Environmental Health
Salesforce QA Analyst ensuring environmental health applications function correctly while supporting public health initiatives at Flourish and Thrive Labs.
QA Automation Developer, Salesforce
QA Automation Developer enhancing Salesforce customizations for mortgage financing technology. Engaging in test automation, system testing, and regression testing within Salesforce applications.
Backend QA Engineer
Backend QA Engineer testing APIs and databases to ensure reliability and performance at Air Apps. Collaborate with engineering teams to maintain high-quality standards across infrastructure.
Backend QA Engineer
Backend QA Engineer ensuring reliability, performance, and scalability of backend systems at Air Apps. Collaborating on API, database, and service integrity testing.
Backend QA Engineer
Backend QA Engineer at Air Apps to ensure reliability, performance, and scalability of backend systems along with testing APIs and databases.
Business Analyst, Tester
Test Engineer providing expertise in business process and system analysis and design at GDIT. Collaborating with teams to enhance DevSecOps processes and ensure testing compliance.
Director, Compliance – Quality Assurance
Director of Compliance & Quality Assurance responsible for upholding quality standards in telehealth. Leading compliance initiatives at a remote mental healthcare provider to ensure safety and regulatory adherence.
Quality Assurance Analyst
ISSS Quality Assurance Analyst ensuring software accurately supports regulatory workflows in international education. Collaborating with product and engineering teams on quality assurance and testing processes.
Environmental Health System QA Analyst – Public Health
Environmental Health QA Analyst ensuring environmental health apps work effectively for public health agencies. Developing test plans and collaborating with tech teams to enhance system usability.
Quality Assurance Team Lead
QA Lead guiding a team of Service Quality Engineers at Mark43. Partnering with Engineering to define testing strategies and improve product quality.
Quality Assurance Engineer
QA Engineer focusing on Android testing at Reveal, a startup revolutionizing field operations with software tools. Ensuring quality across mobile and cloud systems in a dynamic environment.
QA Analyst
QA role executing manual tests in web, mobile apps and APIs for international team. Requires collaboration with development teams and participation in agile rituals.
QA Engineer
QA Automation Engineer at Proofpoint developing automated tests using Python and ensuring software quality. Collaborating with developers and QA professionals to enhance testing processes.
QA Team Lead
QA Team Lead responsible for testing and managing QA Engineers at StorMagic. Focused on enhancing quality standards for HCI products through leadership and technical expertise.
Senior Software Quality Assurance Engineer
Senior Software Quality Assurance Engineer building automation systems at Insider One. Collaborating with teams to ensure high-quality products throughout the development lifecycle.