MSR Project – Spanish Culture Expert

Posted 16hrs ago

Employment Information

Industry
Education
Salary
Experience
Job Type

Report this job

Job expired or something wrong with this job?

Job Description

Spanish (Spain) culture expert testing search queries and evaluating AI response quality. Identifying local, linguistic, source-quality, and region-specific failures for Welo Data’s language evaluation project.

Responsibilities:

  • Identify realistic search-related failures where an AI model provides inadequate responses
  • Create and test search queries
  • Document what went wrong
  • Write instructions and evaluation criteria for correct answers
  • Evaluate local relevance, source quality, outdated information, language mismatches, incomplete answers, and region-specific inapplicability
  • Test multiple queries before finding failures

Requirements:

  • Spanish-speaking expert
  • Research skills: ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
  • Critical thinking: ability to spot contradictions between sources, identify outdated information, and recognize when information does not apply to a specific locale or context
  • Attention to detail: ability to catch language nuances, local variations such as prices, regulations, and requirements, and edge cases
  • Problem-solving mindset: comfortable iterating and testing when things do not work
  • Domain knowledge in research, quality assurance, compliance, or similar precision- and source-verification work is ideally desired
  • Writing clarity: ability to articulate instructions and rubrics clearly
  • Deep familiarity with the specific locale, including local regulations, business practices, and cultural nuances, is valuable

Benefits:

  • Ongoing project
  • 20 hours per week commitment