Senior AI Engineer – Location AI
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior AI Engineer building evaluation-driven LLM systems, data pipelines, and agent tooling for Mapbox's real-time location platform. Owning production AI quality, latency, and reliability across teams.
Responsibilities:
- Define product behavior, measurement frameworks, evaluation systems, datasets, and regression gates for non-deterministic AI products
- Continuously evaluate APIs, SDKs, data representations, and reference applications from end-user perspectives
- Identify misuse, integration anti-patterns, and product gaps; recommend and implement fixes
- Own MVP delivery against a technical design while balancing quality and useful increments
- Build data pipelines and tooling for ingestion, conflation, entity resolution, quality checks, and batch/streaming processing
- Track and evaluate external datasets, models, benchmarks, research, and open-source releases
- Design feedback loops and instrumentation that provide reproducible failure context
- Design model-tool boundaries and build or improve model harnesses
- Optimize request latency and cost through streaming, partial results, caching, model routing, and prompt structure
- Build internal CLI, MCP, and other engineering tools and share reusable components
- Conduct code and design reviews and mentor engineers on evaluation practices
- Investigate unresolved technical questions in AI systems
- Participate in a 24/7 on-call rotation to maintain system availability
Requirements:
- Bachelors degree in a STEM discipline
- 5+ years of software engineering experience with production ownership of services, pipelines, or SDKs
- 2+ years shipping LLM-backed features to real users in systems with error budgets, on-call rotations, and customer-facing regressions
- Direct experience or deep understanding of designing evaluations for non-deterministic systems
- Experience building datasets and identifying failures caught by evaluation
- Data engineering depth, including SQL and at least one distributed processing framework
- Experience with pipelines where data correctness is critical
- Fluency with tool calling and agent orchestration, including stale context, hallucinated arguments, silent partial success, and unbounded loops
- Working knowledge of more than one agent harness
- Strong Python or TypeScript skills and ability to read code in other languages
- Experience diagnosing latency in distributed request paths
- Clear written communication
- Ability to participate in an on-call rotation, including immediate response outside normal working hours and weekends
- Nice to have: geospatial data experience, public API or SDK design, MCP or similar tool transports, CI evaluations, automotive/IVI/CarPlay/Android Auto, voice pipelines, constrained or offline compute, and first external integrations
Benefits:
- Supportive health care
- Parental leave
- Flexible work arrangements
- Professional development and learning opportunities
- Private health, dental, and income protection plans tailored to regional statutory benefits
- Family care, maternity and paternity leave policies
- Lifestyle Spending Account contributions supporting health, wellness, and personal growth
- Mental health support for employees and dependents
- Paid time away, company holidays, and generous absence policies
- Dedicated paid volunteering time
- Remote work flexibility and periodic office work where applicable
Similar Jobs
AI/Enterprise Architect Engineer, AI Specialist – Content Developer
AI systems engineering content developer creating production-grade educational materials for Jala University. Applying AI architecture, migration, documentation, and compliance expertise to practical industry-focused education.
AI Engineer – RAG and Agents, Content Developer
AI content developer creating RAG and agent curriculum for Jala University's Master in AI Systems Engineering. Developing practical, industry-aligned education for underserved regions.
AI Architect
AI Architect scaling AI pipeline infrastructure for The Information, a technology and business journalism publisher. Designing reliable LLM workflows, observability, and high-fan-out platform capabilities.
Senior AI Engineer, Agents
Senior AI Engineer advancing clinical AI agents for a Latin American healthtech company. Designing ontologies, fine-tuning models, and building evaluations for production healthcare workflows.
Senior AI Engineer, Location AI
Senior AI Engineer building LLM-backed evaluation systems, agent tooling, and data pipelines. Improving Mapbox's real-time location platform across Search, Places, Navigation, and developer tools.
Senior AI Architect
Senior AI Architect designing production-ready AI architectures for Genesys Cloud customer-experience orchestration. Leading presales discovery, prototypes, integrations, and executive technical engagements.
Senior Software Engineer – AI, Search
Senior Software Engineer building Ford’s Java cloud-native eCommerce microservices platform. Designing scalable, fault-tolerant services and search capabilities for future mobility.
Director, AI Engineering
Director leading Capital One’s AI infrastructure and optimization systems. Building responsible, scalable AI capabilities that transform customer and associate banking experiences.
Senior/Lead Forward Deployed AI Engineer
Senior AI engineer deploying Claude-powered enterprise workflows and integrations for NewRocket’s ServiceNow customers. Building secure, evaluated, reusable AI solutions across enterprise environments.
Forward Deployed AI Engineer
Forward Deployed AI Engineer delivering Claude-powered AI workflows, integrations, and automations for NewRocket enterprise clients. Building secure, scalable solutions across ServiceNow and broader business ecosystems.
AI Engineer – Campus Hire
Early-career AI Engineer building Claude-powered, agentic AI and RAG solutions for NewRocket, an AI-first ServiceNow partner. Supporting enterprise automation, evaluation, and deployment.
AI Engineer
AI Engineer building Cognigy conversational AI, LLM, and API integrations. Supporting Acliviti’s enterprise customer-experience and technical-transformation consulting clients.
Senior Software Engineer – AI
Senior AI Engineer building production AI features for Usersnap’s SaaS feedback platform. Owning fullstack architecture, LLM integrations, evaluation, and reliable launches.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building AI/ML and evaluation infrastructure for Thumbtack's home-services marketplace. Designing scalable GenAI platforms, model systems, and developer tooling.
Staff Software Engineer, AI/ML Infrastructure
Staff Software Engineer building scalable AI/ML platforms and evaluation systems. Enabling Thumbtack’s home-services marketplace and GenAI-powered customer experiences.
Software, AI Architect
Software & AI Architect building Brightfin’s AI-native platform for IT financial management, technology expense management, and FinOps. Owning architecture, AI capabilities, infrastructure, and governance.
Staff AI Engineer
Staff AI Engineer building retrieval, inference, and agentic systems for Acquia’s Drupal-based digital experience platform. Shipping shared AI capabilities that turn enterprise data signals into customer workflows.
Lead AI Engineer
Lead AI Engineer modernizing InsCipher’s insurance compliance platform with production GenAI and agentic systems. Defining AI architecture, LLMOps standards, and enterprise engineering practices.
Technical Lead, AI and Automation
Líder técnico de IA e automação conduzindo arquitetura, governança e inovação. Impulsionando a transformação digital da Solo Network Brasil com times e embaixadores.
Software Engineer, AI, IT, Data Evaluator
AI evaluator reviewing software, IT, and data artifacts for accuracy and quality. Providing structured feedback to help Mercor and leading AI labs train frontier models.