Quality Assurance Analyst – AI Data Annotation
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
QA Analyst responsible for quality auditing of AI/ML data annotation at Expedock. Collaborating with teams to improve data accuracy and provide feedback to annotators.
Responsibilities:
- Quality Auditing: Review annotated data (images, text, video, or audio) based on defined guidelines, perform random and targeted 25% sampling (initial), identify errors, inconsistencies, and edge cases
- Error Analysis & Reporting: Categorize errors (e.g., labeling, bounding box accuracy, classification mistakes), track QA metrics such as accuracy rate, defect rate, and rework volume, provide daily/weekly QA reports with actionable insights
- Feedback & Coaching: Deliver structured feedback to annotators, conduct calibration sessions to ensure alignment on guidelines, support Team Leads in coaching low-performing annotators
- Guideline Adherence & Improvement: Ensure strict compliance with annotation guidelines and client requirements, flag ambiguous cases and recommend guideline improvements, collaborate with Ops/Training teams to refine SOPs
- Process Improvement: Identify trends and recurring quality issues, recommend workflow enhancements to improve accuracy and efficiency, support pilot runs and new workflow validation
Requirements:
- Bachelor’s degree or equivalent experience
- 1–2 years experience in QA, data annotation, or BPO operations (preferred)
- Strong attention to detail and analytical skills
- Experience reviewing datasets (image, text, or video) is a plus
- Familiarity with annotation tools (e.g., CVAT, Labelbox, etc.) is an advantage
Similar Jobs
Doctor QA Specialist
Doctor QA Specialist ensuring quality patient communication for telehealth brands. Focused on quality assurance, compliance, and communication excellence across provider messaging.
Property Claims Quality Assurance Intern
Claims Quality Intern at California Fair Plan conducting research and vendor selection for claims review software. Collaborating with departments to enhance efficiency and accuracy in claims auditing.
Property Claims Quality Assurance Supervisor
Claims Quality Assurance Supervisor leading QA teams for property claims accuracy and compliance. Overseeing communications with the Department of Insurance and supporting Claims Examiners.
QA Analyst
QA Analyst ensuring software quality for innovative banking solutions at Stefanini. Managing testing processes and supervising external providers to uphold standards and documentation.
QA Engineer – Manual and Automation
Senior Quality Engineer responsible for designing automated test coverage for integration workflows. This role requires strong experience in Playwright and significant QA involvement in the healthcare sector.
Junior QA Engineer
Junior QA Engineer supporting testing of mobile applications for Virtusan. Handling functional, regression, and usability testing for iOS and Android devices.
Senior Supplier Quality Engineer
Supplier Quality Engineer responsible for overseeing supplier performance and compliance. Analyzing processes, ensuring quality standards, and collaborating with internal and external stakeholders.
QA Engineer
Manual QA Engineer ensuring product stability for a fintech SaaS company. Collaborating on product testing across frontend and backend systems to enhance quality.
Quality Engineering Technical Lead
Technical Lead in Quality Engineering, overseeing test strategy and automation in a global game services provider. Collaborate with teams to ensure high-quality standards across platforms.
Pentester
Pentester simulating attacks to identify vulnerabilities across networks and cloud infrastructure at Cyber Defence. Collaborating with teams to enhance client resilience and compliance.
Web QA Engineer
Web QA Engineer ensuring quality of a web-based photo editing product combining frontend and backend technologies. Validate UI and APIs with a focus on automation and efficiency.
Mobile Tester, iOS
Tester de aplicaciones móviles en Capgemini, desarrollando y ejecutando planes de prueba para sistemas Web/Digital. Validando integraciones y realizando pruebas transaccionales en plataformas iOS y Android.
Senior Quality Assurance Engineer
Senior QA Engineer responsible for QA processes and automation in IT projects for a fast-growing company. Collaborating with technical teams to improve product quality in various applications.
Quality Assurance Analyst – Co-op
QA Analyst Co-op for Real Estate Webmasters focused on software testing and product quality. Collaborating with a product team to ensure high standards in web applications.
Global Quality Assurance – Work-Study
Quality Assurance Intern for UPSA, participating in Global Quality activities and audits. Supporting compliance and documentation processes in the pharmaceutical field.
Quality Assurance Analyst
QA Analyst supporting Case Management Modernization Program at GDIT. Ensuring quality assurance for cloud-based data solutions across US federal courts with compliance testing.
Senior Quality Engineer
Sr. Quality Engineer I responsible for developing test automation frameworks at TrueML, a fintech company enhancing customer experiences for distressed borrowers.
Automation Tester
Automation Tester developing automated test scripts at Mind Computing. Ensuring software quality and functionality through analysis, execution, and collaboration.
Functional Tester
Functional Tester ensuring software quality and defect-free applications. Collaborating closely with developers and QA analysts, optimizing testing processes with latest tools and techniques.
FCRM Quality Assurance Analyst II
Financial Crime Risk Analyst II providing analytical support to FCRM programs and collaborating with stakeholders. Involves data analysis, reporting, and process improvements in financial crime risk management.