AI Quality Evaluator, Italian
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Quality Evaluator assessing Italian-language AI content, datasets, and designs for Canva’s global design platform. Ensuring linguistic quality, accuracy, and cultural relevance.
Responsibilities:
- Label, annotate, and evaluate photos, graphics, videos, stickers, and designs in Italian
- Assess linguistic quality, accuracy, and cultural appropriateness
- Evaluate AI-generated content against Canva’s quality bar for Italian users
- Build and contribute to Italian-specific datasets supporting Canva AI internationalisation
- Deliver labelled assets on time and meet output targets across task types and labelling guidelines
- Review and refine labels based on feedback to maintain accuracy and consistency
- Collaborate with in-house Data Labelling teams across the Philippines and EU for quality alignment
Requirements:
- Native Italian speaker
- Strong written and spoken English
- High attention to detail and commitment to a high quality bar
- Ability to self-direct and manage time across multiple concurrent projects
- Adaptability and ability to quickly learn and consistently apply new guidelines
- Genuine curiosity about AI
- Ability to thrive in a fast-paced, evolving environment
- Pronouns and any reasonable adjustments must be provided during the contractor-accreditation interview process
Benefits:
- Flexible, remote-friendly ways of working
- 12-month engagement working full-time hours
- Virtual contractor-accreditation meetings
- Reasonable adjustments during the contractor-accreditation interview process
Similar Jobs
AI Value Engineer
AI Value Engineer helping PhoenixTeam’s mortgage clients adopt generative AI workflows. Leading experiments, client enablement, and GenAI learning labs for regulated environments.
AI Safety Red Teamer
AI Safety Red Teamer adversarially testing Mercor’s frontier AI systems. Identifying jailbreaks, hallucinations, and policy failures across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer uncovering vulnerabilities in frontier AI models for Mercor. Designing adversarial tests and improving model safety with leading researchers.
AI Enablement Engineer
AI Enablement Engineer building AI tools, automations, and production systems for Phorest’s global salon software platform. Measuring business impact and scaling effective solutions.
AI Quality Evaluator – Spanish
AI Quality Evaluator assessing Spanish AI-generated design content for Canva. Creating datasets and labels to improve localisation quality for Spanish users.
AI Facial Data Collection Associate, Twins
Twin participants submitting unedited facial photos and videos for 24-MAG’s AI biometric data research project. Completing separate applications and quality-controlled digital submissions.
AI Safety Experts, English – Punjabi
AI safety red teamer probing conversational models for Mercor’s human-data AI projects. Generating adversarial datasets, vulnerability classifications, and reproducible attack reports.
Working Student – Innovation, AI & Entrepreneurship
Werkstudent für AI- und Innovationsprogramme bei G+D, einem globalen Sicherheitstechnologieunternehmen. Analyse von Geschäftsideen, Entwicklung von Innovation Communities und Erprobung neuer AI-Tools.
AI Solution Consultant – AI Transformation Consultant
AI Solution Consultant bei TP, Weltmarktführer im digitalen Business Process Outsourcing. Entwicklung kundenorientierter AI-Lösungen, Roadmaps und Business Cases für bessere Customer Experience.
AI Tutor – Video, Weekend
Video Specialist training SpaceXAI’s Grok AI to interpret and generate video content. Producing annotated, curated video data using editing, motion graphics, and VFX expertise.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Identifying jailbreaks, hallucinations, and policy failures to improve AI safety.
AI Safety Experts – English, Norwegian
AI safety red team expert probing Mercor’s partner AI models for vulnerabilities. Generating adversarial datasets, attack cases, and reproducible safety reports.
AI Safety Expert, English, Finnish
AI safety red team expert probing Mercor’s frontier AI models for vulnerabilities. Generating adversarial datasets, reports, and attack cases to improve customer AI safety.
AI Safety Expert – English, Norwegian
AI safety red team expert probing Mercor’s partner AI models for vulnerabilities. Generating adversarial datasets, attack cases, and reproducible safety reports.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier models for Mercor, which partners with AI labs to train and enhance AI systems. Identifying vulnerabilities across high-risk domains.
AI Safety Red Teamer
AI Safety Red Teamer identifying vulnerabilities in frontier AI systems for Mercor’s AI training projects. Designing adversarial prompts and evaluating high-risk model behaviors.
Especialista en Inteligencia Artificial Agente, Banca
Ingeniero de software diseñando soluciones escalables con agentes inteligentes, APIs y automatización. Empresa tecnológica especializada en activos digitales, staffing y fábrica de software.
AI Agent Power User
Part-time AI workflow consultant evaluating ChatGPT and Claude across realistic business processes. Scoring outputs, documenting model behavior, and providing actionable feedback for 24-MAG’s AI projects.
AI Evaluation Specialist
AI Evaluation Specialist assessing AI-generated outputs, reasoning, and tool use for 24-MAG LLC’s remote consulting platform. Providing rubric-based quality evaluations and actionable written feedback.
AI Safety Red Teamer
AI Safety Red Teamer stress-testing frontier AI models for Mercor. Designing adversarial prompts, identifying vulnerabilities, and improving model safety with leading AI researchers.