MSR Project – Spanish, LATAM Culture Expert
Posted 16hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Spanish LATAM language expert evaluating AI search failures for Welo Data. Creating queries, documenting issues, and writing evaluation criteria for accurate, locally relevant answers.
Responsibilities:
- Identify realistic search-related failures where an AI model provides inadequate responses
- Create and test search queries
- Document what went wrong
- Write instructions and evaluation criteria for correct answers
- Evaluate local relevance, source quality, information freshness, language matching, answer completeness, and region-specific applicability
- Test multiple queries before finding failures
Requirements:
- Research skills — ability to find and verify information from multiple sources; comfort navigating different websites, databases, and documentation
- Critical thinking — Can spot contradictions between sources, identify outdated information, and recognize when something doesn't apply to a specific locale/context
- Attention to detail — Can catch nuances in language, local variations (prices, regulations, requirements), and edge cases
- Problem-solving mindset — Comfortable iterating and testing when things don't work; doesn't get frustrated by trial-and-error
- Domain knowledge — Ideally someone with background in research, quality assurance, compliance, or similar work that requires precision and source verification
- Writing clarity — Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning
- Locale knowledge — Deep familiarity with their specific locale (local regulations, business practices, cultural nuances) is valuable for spotting region-specific failures
- Spanish LATAM-speaking expertise
Benefits:
- Ongoing project
- 20 hours per week commitment









