Senior AI Engineer, Location AI
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior AI Engineer building LLM-backed evaluation systems, agent tooling, and data pipelines. Improving Mapbox's real-time location platform across Search, Places, Navigation, and developer tools.
Responsibilities:
- Define product behavior, measurement frameworks, and evaluation systems for non-deterministic behavior
- Formulate product hypotheses and validate them with relevant signals
- Define correct results, assemble datasets, and gate changes on regression results
- Continuously evaluate APIs, SDKs, data representations, and reference applications from end-user perspectives
- Identify misuse, integration anti-patterns, and product gaps; recommend and implement fixes
- Own MVP delivery against an agreed technical design while balancing perfection with useful increments
- Build data pipelines and tooling for ingestion, conflation, entity resolution, quality checks, and batch/streaming jobs
- Track and evaluate external datasets, models, benchmarks, published research, and open-source releases
- Design feedback loops and instrumentation to reproduce failures and convert recurring issues into evaluation cases
- Design model/tool boundaries and build or improve model harnesses
- Optimize latency and cost per request through streaming, partial results, caching, model routing, and prompt structure
- Build internal CLI, MCP, and related tools; share reusable components across teams
- Raise engineering standards through code and design reviews and teach evaluation practices
- Help answer unresolved technical questions in the field
- Participate in a 24/7 on-call rotation to maintain system availability
Requirements:
- Bachelor's degree in a STEM discipline
- 5+ years of software engineering experience with production ownership of services, pipelines, or SDKs
- 2+ years shipping LLM-backed features to real users in systems with error budgets, on-call rotations, and customer-visible regressions
- Data engineering depth: SQL and at least one distributed processing framework
- Experience with pipelines where incorrect records matter more than processing speed
- Fluency with tool calling and agent orchestration, including stale context, hallucinated arguments, silent partial success, and unbounded loops
- Strong Python or TypeScript skills
- Comfort reading code in other programming languages
- Experience or deep understanding of designing evaluations for non-deterministic systems
- Ability to describe a dataset built and the failure it caught
- Working knowledge of more than one agent harness
- Experience diagnosing latency in a distributed request path
- Comfort with ambiguity and judgment to ship narrow, functional solutions
- Participation in an on-call rotation, including possible immediate response outside normal working hours and weekends
- Must be able to work remotely from any city in Germany
Benefits:
- Supportive health care
- Parental leave
- Flexible work arrangements
- Environment of teaching and learning
- Private health, dental, and income protection plans tailored to regional statutory benefits
- Family care, maternity and paternity leave policies
- Lifestyle Spending Account contributions supporting health, wellness, and personal growth
- Mental health support for employees and dependents
- Paid time away, company holidays, and generous absence policies
- Dedicated paid volunteering time in addition to standard PTO
- Hybrid/remote flexibility to work from home or periodically from an office where applicable
Similar Jobs
AI/Enterprise Architect Engineer, AI Specialist – Content Developer
AI systems engineering content developer creating production-grade educational materials for Jala University. Applying AI architecture, migration, documentation, and compliance expertise to practical industry-focused education.
AI Engineer – RAG and Agents, Content Developer
AI content developer creating RAG and agent curriculum for Jala University's Master in AI Systems Engineering. Developing practical, industry-aligned education for underserved regions.
AI Architect
AI Architect scaling AI pipeline infrastructure for The Information, a technology and business journalism publisher. Designing reliable LLM workflows, observability, and high-fan-out platform capabilities.
Senior AI Engineer, Agents
Senior AI Engineer advancing clinical AI agents for a Latin American healthtech company. Designing ontologies, fine-tuning models, and building evaluations for production healthcare workflows.
Senior AI Engineer – Location AI
Senior AI Engineer building evaluation-driven LLM systems, data pipelines, and agent tooling for Mapbox's real-time location platform. Owning production AI quality, latency, and reliability across teams.
Senior AI Architect
Senior AI Architect designing production-ready AI architectures for Genesys Cloud customer-experience orchestration. Leading presales discovery, prototypes, integrations, and executive technical engagements.
Senior Software Engineer – AI, Search
Senior Software Engineer building Ford’s Java cloud-native eCommerce microservices platform. Designing scalable, fault-tolerant services and search capabilities for future mobility.
Director, AI Engineering
Director leading Capital One’s AI infrastructure and optimization systems. Building responsible, scalable AI capabilities that transform customer and associate banking experiences.
Senior/Lead Forward Deployed AI Engineer
Senior AI engineer deploying Claude-powered enterprise workflows and integrations for NewRocket’s ServiceNow customers. Building secure, evaluated, reusable AI solutions across enterprise environments.
Forward Deployed AI Engineer
Forward Deployed AI Engineer delivering Claude-powered AI workflows, integrations, and automations for NewRocket enterprise clients. Building secure, scalable solutions across ServiceNow and broader business ecosystems.
AI Engineer – Campus Hire
Early-career AI Engineer building Claude-powered, agentic AI and RAG solutions for NewRocket, an AI-first ServiceNow partner. Supporting enterprise automation, evaluation, and deployment.
AI Engineer
AI Engineer building Cognigy conversational AI, LLM, and API integrations. Supporting Acliviti’s enterprise customer-experience and technical-transformation consulting clients.
Senior Software Engineer – AI
Senior AI Engineer building production AI features for Usersnap’s SaaS feedback platform. Owning fullstack architecture, LLM integrations, evaluation, and reliable launches.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home-services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building scalable AI/ML platforms and evaluation systems. Enabling Thumbtack’s home-services marketplace and GenAI-powered customer experiences.
Software, AI Architect
Software & AI Architect building Brightfin’s AI-native platform for IT financial management, technology expense management, and FinOps. Owning architecture, AI capabilities, infrastructure, and governance.
Staff AI Engineer
Staff AI Engineer building retrieval, inference, and agentic systems for Acquia’s Drupal-based digital experience platform. Shipping shared AI capabilities that turn enterprise data signals into customer workflows.
Lead AI Engineer
Lead AI Engineer modernizing InsCipher’s insurance compliance platform with production GenAI and agentic systems. Defining AI architecture, LLMOps standards, and enterprise engineering practices.
Technical Lead, AI and Automation
Líder técnico de IA e automação conduzindo arquitetura, governança e inovação. Impulsionando a transformação digital da Solo Network Brasil com times e embaixadores.
Software Engineer, AI, IT, Data Evaluator
AI evaluator reviewing software, IT, and data artifacts for accuracy and quality. Providing structured feedback to help Mercor and leading AI labs train frontier models.