SDET 3
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior SDET testing Bidgely’s AI-powered utility energy products, dashboards, APIs, and GenAI agents. Building automation and evaluation frameworks to ensure release quality.
Responsibilities:
- Own test strategy and release quality criteria for the product area
- Build and maintain UI automation, API automation and end-to-end regression suites
- Design evaluation strategy for AI agents using LLM-as-judge, rubrics and other evaluation techniques
- Build eval datasets and automated evaluation suites in Python integrated with CI/CD
- Test AI agents for accuracy, consistency, tool usage, safety and data handling
- Debug agent failures using LangSmith and similar AI observability tools
- Analyse release-over-release quality and identify regressions
- Review product requirements and identify gaps in requirements and test coverage
- Review test code, set testing standards and mentor SDETs
- Communicate findings and recommendations to engineering, product and leadership
- Work closely with GenAI engineering, CX engineering and product teams
Requirements:
- 6–9 years in software testing, including hands-on SDET experience
- Good working knowledge of Python and Java
- Experience owning test strategy and improving automation and release quality
- Experience with UI automation using Selenium or Playwright
- Experience building API automation and end-to-end frameworks with CI/CD
- Ability to analyse product requirements and identify testing gaps
- Prior experience testing chatbots, IVRs and GenAI agents
- Experience designing evals, rubrics and LLM-as-judge evaluations
- Working knowledge of LangChain, LangGraph and LangSmith or similar tools
- Experience building eval harnesses or tooling for AI agents
- Strong analytical and communication skills
Benefits:
- Remote work arrangement
- Certified Great Place to Work engineering center
Similar Jobs
Senior QA Automation Engineer
Senior QA Automation Engineer maintaining and evolving automated test suites for Nagarro's digital product engineering services. Designing frameworks and AI-driven testing workflows across complex software integrations.
Automation Architect
Automation Architect leading Python, AI, and agentic security automation at Lilly, a life-sciences company developing life-changing medicines. Managing engineers and shaping cloud and application security tooling.
Senior Software Development Engineer in Test, QA - AI Systems
Senior SDET building evaluation infrastructure and testing autonomous AI agents. Nexxa applies AI systems to heavy industries, manufacturing, infrastructure, logistics, and legacy environments.
Senior QA Automation Engineer, AI-Focused
Senior QA Automation Engineer driving automated web, API, and backend testing for WorkMotion’s global workforce platform. Applying AI tools to improve QA efficiency and release quality.
QA Engineer – Automation
QA Engineer automating testing frameworks and suites for TransUnion’s software and data services. Debugging products, identifying defects, and supporting reliable system integration.
Software Test Automation Engineer
Software Test Automation Engineer building scalable automated tests for web, API, and backend systems. Defining CI/CD quality strategies and partnering on DevSecOps testing practices.
QA Automation Engineer, Temporary Position
QA Automation Engineer improving CTERA’s cloud storage product quality through Java API automation, Playwright UI testing, and QA infrastructure. Maintaining Jenkins suites and the QA Cloud Agent.
Senior QA/Automation Test Engineer
Senior QA/Automation Test Engineer leading automation, testing strategy, and DevSecOps quality for Guidehouse’s enterprise software platforms. Driving reliable releases and mentoring QA engineers.
Lead Automation Architect
Lead Automation Architect designing secure Ansible and Jenkins automation for Peraton’s Federal Financial infrastructure. Driving scalable solutions across air-gapped and AWS GovCloud environments.
Senior Software Development Engineer in Test
Senior SDET automating testing, deployment, and validation for Akamai's Kubernetes-based cloud platform. Building reliable test frameworks for distributed cloud and edge services.
Senior Test Engineer – T24, Mortgage/Lending
Senior Test Engineer testing Temenos T24 core banking applications. Validating mortgage, lending, API, workflow, and integration quality in Agile DevOps environments.
Senior Test Engineer – LD to AA Loans Migration
Senior Test Engineer validating Temenos T24 LD-to-AA loan migrations for banking clients in India. Ensuring data integrity, financial reconciliation, and digital banking workflow readiness.
Senior Test Engineer – Mobile App Testing, T24
Senior Test Engineer ensuring quality and security of digital banking mobile and web applications. Testing APIs, payment workflows, wallets, and Temenos T24 integrations.
Staff Software Engineer in Test – Mobile
Staff Software Engineer in Test improving mobile and backend quality for InPost’s European parcel delivery platform. Defining quality strategy, release gates, AI governance, and engineering standards across teams.
Senior QA Engineer – Automation
Senior QA Engineer building test automation frameworks and validating APIs, user journeys, and databases. Integrating automated tests into CI/CD to prevent release defects.
Salesforce Automated Test Engineer
Salesforce Automated Test Engineer building scalable QA automation frameworks for enterprise Salesforce operations. Integrating Tosca, TestRail, APIs, and CI/CD testing pipelines.
Senior SDET
Senior SDET building Playwright and TypeScript test automation for Suralink’s AI accounting SaaS platform. Driving shift-left and shift-right quality across cloud-native products.
Senior Test Software Engineer
Senior Test Software Engineer architecting automated testing and CI/CD for Focus, a civic technology services firm serving government agencies. Building synthetic data tools and supporting FedRAMP-compliant cloud infrastructure.
Software Development Engineer in Test
Software test engineer automating web, mobile, and application quality for Republic Services, an environmental services company. Building test frameworks across Agile software delivery pipelines.
Automation Architect
Automation Architect leading scalable AI and automation workflows for Ansira's Colombia-based AI Center of Excellence. Managing developers and setting architecture, integration, and governance standards.