AI Annotator
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Quality Assurance Specialist supporting Probook AI by auditing calls of AI-driven customer service representatives. Validating booking accuracy and providing feedback for improvement.
Responsibilities:
- Review and listen to calls handled by Probook AI’s AI CSR to ensure all customer-specific expected behaviors, scripts, and workflows are followed accurately
- Annotate and document detailed agent feedback directly into customer-specific databases
- Identify trends, errors, or deviations and log issues in the company issue tracker, creating actionable tickets for internal teams
- Verify booking accuracy for all appointments scheduled by the AI CSR
- Validate the legitimacy of true booking opportunities, ensuring bookings meet defined criteria
- Annotate a minimum of 120 calls per day with accuracy and consistency
- Provide clear, actionable feedback and improvement suggestions to enhance the AI CSR’s booking performance and customer experience
- Collaborate with internal teams (QA, Product, Engineering, Operations) to support continuous improvement initiatives
Requirements:
- 1+ year of hands-on experience using the ServiceTitan platform
- 2+ years of experience working within a trades-based service company (HVAC, Plumbing, Electrical, or similar)
- 2+ years of experience in a Quality Assurance role, auditing and grading CSR calls
- 3+ years of experience as a Customer Service Representative within a service-based company
- Proven experience evaluating call quality, booking outcomes, and adherence to call flows
Benefits:
- Fully remote opportunity
- Pay in lieu of benefits
- Company-supplied equipment
- Opportunity to work at the forefront of AI-driven customer service innovation
Similar Jobs
AI Marketing Manager
AI Marketing Manager responsible for designing and implementing AI-powered marketing initiatives for multiple brands. Develop insights-driven strategies to accelerate growth and enhance customer engagement.
HPC/AI Sales Specialist
HPC/AI Sales Specialist responsible for building relationships with enterprise accounts in the financial services and life sciences sectors. Driving business development with a focus on customer success.
FreeCAD BIM/IFC Specialist – AI Trainer
FreeCAD BIM/IFC Specialist evaluating AI-generated content for computational design tasks and BIM coordination workflows. Flexibly engage in project-based opportunities remotely in the US.
BlenderBIM Specialist – AI Trainer
BlenderBIM user supporting AI research through flexible contract work with Handshake. Evaluating AI content and providing feedback for BIM tasks and workflows.
Audacity Specialist – AI Trainer
Audacity Specialist supporting AI research through flexible hourly contract work. Evaluating AI-generated audio content and providing detailed feedback based on hands-on experience.
Ardour Specialist – AI Trainer
Ardour Specialist reviewing AI-generated content related to audio engineering for Handshake. The role involves leveraging expertise in audio production workflows and Ardour usage.
3D Slicer Specialist – AI Trainer
3D Slicer Specialist supporting AI research via flexible, project-based contract work. Utilize medical imaging expertise to evaluate AI-generated content in research workflows.
OpenShot Specialist – AI Trainer
OpenShot Specialist leveraging video editing expertise for AI content evaluation and feedback on a contract basis.
Ngspice Specialist – AI Trainer
Ngspice Specialist using hands-on experience for AI research and evaluating AI-generated content. Opportunity involves flexible hours and independent contract work with no minimum hour requirement.
LMMS Specialist – AI Trainer
LMMS Specialist using experience with music production to support AI research through contract work. Flexible, remote work managing project-based opportunities.
LibreSprite Specialist – AI Trainer
LibreSprite Specialist evaluating AI-generated content to enhance pixel art and game asset workflows for Handshake's AI program. Work is flexible and project-based for experienced users.
LibrePCB Specialist – AI Trainer
LibrePCB Specialist supporting AI research through flexible, project-based contract work. Evaluating AI-generated content and improving electronics design understanding.
Krita Specialist – AI Trainer
AI Trainer supporting research through Krita expertise. Evaluating AI-generated content and providing feedback on visual tasks and creative workflows.
KiCad Specialist – AI Trainer
KiCad Specialist supporting AI research through project-based contract work and evaluating AI-generated content related to electronics design.
Inkscape Specialist – AI Trainer
Inkscape Specialist contributing to AI research by evaluating and providing feedback on AI-generated designs. Flexibly working on project-based tasks from anywhere in the United States.
Godot Specialist – AI Trainer
Godot Specialist supporting AI research through flexible hourly contract work. Leveraging hands-on game development experience for evaluating AI-generated content.
GIMP Specialist – AI Trainer
GIMP Specialist supporting AI research through flexible contract work in image evaluation and feedback. Collaborating with AI to enhance visual understanding and workflows utilizing GIMP.
ParaView Specialist – AI Trainer
ParaView Specialist supporting AI research through flexible contract work. Evaluating AI-generated content to enhance understanding of scientific tasks and HPC workflows.
AI and Integrations Specialist
AI & Integration Specialist designing scalable workflows and integrating systems for clients at 9H. Focus on turning AI capabilities into real-world business solutions.
Adjunct Faculty, Artificial Intelligence – Information Technology
Teach Artificial Intelligence Bachelor’s program online at UMGC. Engage students actively and provide constructive feedback in their learning.