LLM AI Quality Analyst, Chinese
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Chinese-speaking AI Quality Analyst evaluating personalized responses for a leading AI technology company. Creating prompts, reviewing accuracy, detecting hallucinations, and providing detailed rationales.
Responsibilities:
- Evaluate personalized AI responses and determine their quality
- Create multi-turn prompts based on personal experiences and context
- Review AI responses for accuracy, helpfulness, and appropriate personalization
- Identify incorrect personalization, unsupported assumptions, and hallucinations
- Compare AI responses side-by-side and provide detailed feedback
- Write clear rationales explaining evaluations
- Complete the online assessment within 24 hours
- Participate in a pre-onboarding discussion
Requirements:
- Strong Chinese reading and writing skills
- Excellent analytical and critical-thinking skills
- Strong written communication
- Experience in AI evaluation, data annotation, content moderation, linguistics, research, or a related area is preferred
- Bachelor's degree or equivalent experience
- Comfortable working independently in a remote environment
- Laptop/desktop with reliable internet
- Willingness to use a primary personal Google account and enable relevant personal data sources for the evaluation
- Availability for 30 or 40 hours per week
- Minimum 4 hours per day
- Ability to provide 4 hours of overlap with PST
- Must be located in the USA; sourcing is excluded from Texas and Illinois
- Strong Chinese language proficiency
Benefits:
- Flexible remote work environment
- Student-friendly opportunity
- Paperless pay statement
- Medical benefits
- Vision benefits
- Flexible spending account for medical and dependent care
- Dental benefits
Similar Jobs
AI Safety Expert – English, Assamese
AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible safety reports.
AI Safety Expert – English, Gujarati
AI red-teaming expert probing conversational models for Mercor, which partners with AI labs to train frontier systems. Generating adversarial data, vulnerability reports, and reproducible attack cases.
AI Safety Expert, English, Gujarati
AI red-teaming expert probing Mercor customer models for jailbreaks, bias, and misuse. Generating reproducible human-data artifacts that improve frontier AI safety.
AI Safety Expert – English, Tamil
AI safety red teamer probing conversational AI models for Mercor, which partners with leading AI labs to train frontier systems. Generating vulnerability data, attack cases, and reproducible reports.
AI Safety Experts, English – Marathi
AI red-teaming experts testing Mercor’s frontier models through adversarial English and Marathi analysis. Probing vulnerabilities and producing datasets that make customer AI systems safer.
AI Safety Expert – English, Bengali
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs to train frontier systems. Generating vulnerability data and reproducible attack cases.
AI Safety Expert – English, Urdu
AI safety red teamer probing Mercor-partnered frontier AI models for vulnerabilities. Testing conversational systems and generating actionable human data in English and Urdu.
AI Safety Expert – English, Bengali
AI safety red teamer probing frontier AI models for Mercor, which partners with leading labs and enterprises to train models. Generating vulnerability data and reproducible attack artifacts.
AI Safety Expert, English – Odia
AI safety expert red-teaming conversational AI models for Mercor, which partners with leading AI labs and enterprises. Generating adversarial data, vulnerability annotations, and reproducible safety artifacts.
AI Safety Experts – English, Assamese
AI red-teaming contractor probing conversational models for Mercor, which partners with AI labs and enterprises to train frontier systems. Generating vulnerability data and reproducible attack cases.
AI Safety Expert – English, Gujarati
AI safety red teamer probing conversational AI models for Mercor, which partners with AI labs to train frontier systems. Creating vulnerability data, attack cases, and reproducible reports.
AI Safety Experts, English, Kannada
AI safety experts red-teaming conversational AI models for Mercor, which partners with leading AI labs. Generating human data and reproducible vulnerability reports.
AI Safety Expert, English – Bengali
AI red-team expert probing conversational models for jailbreaks, bias, and misuse. Generating reproducible safety data for Mercor’s frontier AI lab and enterprise customers.
AI Safety Expert – English, Telugu
AI safety experts red-teaming conversational AI for Mercor’s frontier model training projects. Testing vulnerabilities, annotating failures, and producing reproducible safety data.
Lead Marketer – AI Usage Automation
Lead AI-powered customer automation marketing at HubSpot, an AI-powered customer platform. Design personalized journeys, experiments, and communications that help businesses grow.
Lead Marketer, AI Usage Automation
Lead marketer defining AI-powered customer automation and personalized digital journeys at HubSpot, an AI-powered customer platform. Driving experimentation, optimization, and executive reporting.
Lead Marketer, AI Usage Automation
Lead marketer defining AI-powered customer automation and personalized digital journeys. HubSpot provides an AI-powered customer platform connecting marketing, sales, and service.
AI Safety Expert, English, Portuguese
AI safety red teamer probing Mercor’s frontier AI models for vulnerabilities. Generating reproducible attack data to make customer systems safer and more robust.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor, which partners with AI labs to train frontier systems. Identifying vulnerabilities and improving model safety through adversarial testing.
AI Specialist
Especialista em IA liderando projetos de automação, agentes virtuais e governança. Conectando soluções de inteligência artificial às necessidades do Grupo Odilon Santos.