MSR Project – Japanese Culture Expert
Posted 16hrs ago
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Japanese Culture Expert testing AI search failures and writing evaluation criteria. Supporting Welo Data’s language evaluation projects with Japanese locale expertise.
Responsibilities:
- Identify realistic search-related failures where an AI model provides inadequate responses
- Create and test search queries
- Document what went wrong
- Write instructions and evaluation criteria for correct answers
- Evaluate local relevance, source quality, information freshness, language matching, completeness, and region-specific applicability
- Test multiple queries before finding failures
Requirements:
- Japanese-speaking expertise
- Research skills, including finding and verifying information from multiple sources
- Comfort navigating different websites, databases, and documentation
- Critical thinking to spot contradictions, outdated information, and locale/context mismatches
- Attention to detail regarding language nuances, local variations, and edge cases
- Problem-solving mindset and comfort with iterative testing and trial-and-error
- Domain knowledge in research, quality assurance, compliance, or similar precision-focused work is ideally desired
- Ability to articulate instructions and rubrics clearly
- Deep familiarity with the specific locale, including local regulations, business practices, and cultural nuances
- PhD applications only


