Web Researcher – AI Benchmarking
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Web Researcher designing difficult, evidence-traced benchmarks for frontier AI browsing agents. Building reproducible open-web investigations and validation documentation.
Responsibilities:
- Design challenging open-web research problems for evaluating advanced AI browsing agents
- Start from objectively verifiable facts and construct questions that make those facts difficult to discover
- Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities
- Ensure every clue is independently verifiable and subject to clear constraints
- Research across government databases, institutional sources, archives, registries, and PDF documents
- Produce complete evidence trails citing exact pages, tables, sections, or records
- Record validation searches and document what obvious search approaches return
- Test whether research questions remain difficult across multiple search attempts
- Refine questions to eliminate ambiguity while preserving difficulty
- Deliver structured, reproducible research documentation
Requirements:
- Background in reference librarianship, archives, or special collections
- Experience in investigative journalism or professional fact-checking
- Experience with OSINT, due diligence, KYC, or investigative research
- Background in patent, prior-art, or legal-discovery research
- Experience with genealogy or historical records research
- Experience with competitive quizzing, puzzle design, or puzzle-hunt construction
- Familiarity with JSON or structured data formats
- Commitment of 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST
Similar Jobs
Web Researcher – AI Benchmarking
Web Researcher designing difficult open-web problems for frontier AI browsing agents. Building evidence trails and reproducible benchmarks from verifiable facts.
Applied AI Research Intern
Applied AI Research Intern evaluating AI tools across Vulcury’s consulting practice and ventures. Delivering evidence-based adoption, build, partnership, and competitive recommendations to the CEO.
Senior AI Research Scientist, Model-based RL
Senior AI Research Scientist developing model-based reinforcement learning for Phaidra’s AI-powered industrial automation systems. Designing safe agents, world models, and planning controllers for real-world deployment.
Staff Machine Learning Researcher
Staff Machine Learning Researcher advancing deep-learning advertising technology at RTB House. Designing production models, researching bidding solutions, analyzing A/B tests, and mentoring ML researchers.
Applied AI Scientist
Applied AI Scientist building production AI systems for Vantor’s spatial intelligence platform. Transforming geospatial data, imagery, and multimodal models into actionable Earth intelligence.
AI Research Engineer 6 – TL, Algo Core – AI for Member Systems
AI Research Engineer leading Netflix’s reward modeling and multi-objective optimization systems. Shaping promotional decisions across recommendation, personalization, and member experiences.
Senior Data Scientist – AI Research
Sr. Data Scientist advancing AI/ML initiatives for Lyra Health’s evidence-based mental healthcare platform. Building predictive and generative models, data pipelines, and evaluation frameworks for patients, providers, and employers.
US Lawyer – AI Legal Research, Evaluation
US-qualified Lawyer needed for legal research in tech project focusing on AI. Conducting analysis and drafting legal content for various US law topics in a remote capacity.
Senior Threat Researcher – AI, Autonomous Cybercrime
Senior Threat Researcher examining AI misuse in cybercrime for a cybersecurity SaaS firm. Engaging in proactive threat intelligence and producing original research.
Senior Speech AI Researcher
Senior Speech AI Researcher transforming unique data streams into the gold standard for AI training. Bridging mobile users and AI labs, defining research agenda and leading evaluation pipelines.
Head of Market Research – AI-Native Research
Head of Market Research at Maze, defining AI-native methods and building a research organization.
Advanced Specialist, AI Scientist
AI Scientist developing and supporting Pearson’s machine learning assessments and automated scoring solutions. Collaborating with teams to ensure high-quality delivery and innovation in educational technologies.
Senior AI Threat Researcher
Senior researcher focusing on AI and cybersecurity within Sophos, analyzing threat actors' use of AI and driving operational efficiencies. Collaborating across teams to synthesize findings into actionable intelligence strategies.
Principal AI/ML Researcher – Reasoning, Planning, and Decision-making Systems
Principal AI/ML Researcher developing cognitive AI systems for practical decision-making at Airbnb. Leading research and innovation in reasoning and planning frameworks.
AI Research Engineer, Kernel & Inference Optimization
AI Research Engineer driving innovation in model serving and inference architectures for advanced AI systems at Tether. Focusing on optimizing models for responsive, efficient, and scalable AI performance.
AI Research Engineer – Kernel, Inference Optimization
AI Research Engineer at Tether focusing on optimizing model serving and inference architectures for advanced AI systems. Designing scalable performance solutions affecting real-world applications.
AI Research Engineer – Kernel & Inference Optimization
AI Research Engineer at Tether focusing on optimizing model serving and inference architectures. Collaborate globally to develop cutting-edge fintech solutions.
AI Research Engineer – Kernel & Inference Optimization
AI Research Engineer focusing on model serving and inference architectures at Tether. Join the fintech revolution with cutting-edge AI systems and optimizations.
AI Research Engineer – Kernel & Inference Optimization
AI Research Engineer responsible for optimizing model serving and inference architectures. Join Tether to innovate in the fintech space remotely from India.
AI Research Engineer – Kernel & Inference Optimization
AI Research Engineer focusing on model serving and inference at Tether, contributing to advancements in AI systems and architecture. Collaborating with a global team in a dynamic fintech environment.