AI Chatbot Evaluator – Small Business Owners
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Chatbot Evaluator participating in evaluation study using chatbot platforms. Small business owners engaging in prompt creation and response evaluation based on structured guidelines.
Responsibilities:
- Create prompts based on your business needs using provided guidelines
- Engage with multiple AI chatbot platforms
- Evaluate responses based on structured criteria
- Upload screenshots and complete evaluation forms
- Ensure all submissions are accurate and meet quality standards
Requirements:
- Fluent in English (reading and writing)
- Must currently operate a small business (fewer than 10 employees)
- Must be based in the United States
- Strong attention to detail and ability to follow structured guidelines
- Comfortable using online tools and uploading screenshots
Benefits:
- Flexible schedule
Similar Jobs
AI Automation, Integration Specialist
AI automation specialist scaling Primal Storm’s natural-products eCommerce operations. Building Python and API workflows to reduce repetitive work across the company.
Generative AI Analyst
Generative AI Analyst reviewing and annotating Polish content for Welo Data, a global AI data company. Improving datasets and quality processes for multilingual generative AI systems.
AI Safety Expert, English – Dutch
AI safety red teamer probing conversational AI models for Mercor’s human-data AI training projects. Testing vulnerabilities, generating reproducible datasets, and strengthening frontier AI systems.
Marketing Expert – Paid Growth, AI Agent Environments
Paid Growth expert designing and evaluating simulated acquisition tasks for Mercor’s AI training environments. Diagnosing campaigns, budgets, funnels, and journeys using Google Ads, Meta Ads, and GA4 expertise.
AI Safety Expert, English – Dutch
AI safety red team experts probing Mercor-trained frontier AI models for vulnerabilities. Testing conversational agents and producing reproducible datasets, reports, and attack cases.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs and enterprises. Identifying vulnerabilities and improving model safety through adversarial evaluation.
AI Safety Expert, English & Assamese
AI red teaming experts probing conversational models for Mercor, which partners with AI labs and enterprises to train frontier systems. Generating vulnerability data and reproducible attack artifacts.
Senior Design Expert – Paid AI Design Research Study
Senior designers shaping AI design tooling through recorded research sessions for Mercor. Evaluating design quality, critique, and shipping standards while helping train AI systems.
AI Safety Expert, English, Finnish
AI red-teaming experts probing frontier models for Mercor’s human-data AI training projects. Generating vulnerability annotations, attack cases, datasets, and reproducible safety reports.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in Mercor’s frontier AI projects. Designing adversarial prompts and evaluating model safety across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train frontier systems. Identifying vulnerabilities and improving model safety through adversarial testing.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train and enhance them. Identifying vulnerabilities across high-risk domains.
AI Strategy – Digital Implementation
Werkstudent:in entwickelt Website, App und Praxis-Dashboard für MedTech-Startup Xeno Patch. Einsatz von KI-Tools und Nutzerfeedback zur schnellen Produktverbesserung.
AI Safety Expert, English – Odia
AI red teaming expert probing Mercor-trained frontier models for jailbreaks, bias, and misuse. Generating reproducible safety data and vulnerability reports for AI labs and enterprise customers.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated responses for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
AI Evaluator
AI Evaluator analyzing data and reviewing AI-generated content for Gramian Consultancy’s global AI training projects. Providing structured feedback on accuracy, reasoning, and quality.
Software, AI, IT, Data Evaluator
AI Evaluator reviewing documents, spreadsheets, and slide decks for accuracy and domain quality. Helping Mercor’s AI lab partners train and enhance frontier models.
Director, Information Technology – Enterprise AI
Director leading IT, cybersecurity, and enterprise AI strategy for Vehlo, an auto repair technology and financial solutions provider. Governing security, AI platforms, infrastructure, and technology operations.
Senior Director Analyst – Integration and APIs, AI
Senior Gartner analyst shaping AI-era integration and API research. Advising enterprise leaders on MCP, AI gateways, and integration strategy.
Senior Director, Analyst – Tech CEO Business and Strategy Advisor on AI Orchestration
Senior Gartner analyst advising Texas-based technology CEOs on AI Orchestration growth, market dynamics, and innovation. Creating research, frameworks, forecasts, and presentations for Gartner clients and events.