ML Engineer, Agentic Systems
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Staff ML engineer building models, evaluations, and agentic systems for Sourcegraph’s code-understanding products. Improving enterprise code search quality, latency, cost, and reliability.
Responsibilities:
- Set the Code Understanding team's direction for models, evaluations, and agentic systems
- Design and harden multi-step, tool-using agent loops for reliable, observable, affordable enterprise-scale products
- Determine when and how to use evaluations, smoke tests, metrics, and qualitative review
- Select, upgrade, fine-tune, and train models where appropriate
- Improve retrieval, ranking, context windows, and citations for code-grounded answers
- Optimize model cost and latency through profiling, distillation, caching, and right-sizing
- Own meaningful agentic product slices end-to-end from problem framing through rollout and measurement
- Establish evaluations, dashboards, and guardrails for responsible model and prompt changes
- Mentor and up-level teammates in agent engineering
- Engage with customers and translate feedback into requirements, scopes, and milestones
- Contribute across the codebase and influence technical direction beyond the immediate team
- Participate in the on-call support rotation
- Drive roadmap direction and measurable improvements in answer quality, cost, latency, and agentic capabilities
Requirements:
- Staff engineer and technical leader with production machine learning, evaluation, and agent systems expertise
- Personally owned a production model lifecycle from dataset construction through evaluation, production rollout, and monitoring
- Trained or fine-tuned at least one model
- Experience designing reliable, observable, and cost-bounded multi-step agentic systems
- Strong evaluation judgment, including representative datasets, baselines, error taxonomies, and release criteria
- Ability to make quality, latency, and cost tradeoffs using model selection, prompting, retrieval, caching, distillation, and fine-tuning
- Ability to operate autonomously on ambiguous, high-technical-risk problems
- Strong software engineering skills and ability to ship production services
- Comfortable across Go, TypeScript, GraphQL, Postgres, and Docker, or clearly able and eager to learn them
- Fluent with agentic coding tools and able to understand and own every line they submit
- Comfortable in an async-first, multi-service, fast-paced remote environment
- Ability to mentor engineers through pairing, design reviews, and code reviews
- Customer- and product-driven approach
- Working hours must overlap with EST for at least 20 hours per week
Benefits:
- Meaningful equity
- Competitive cash compensation
- Generous perks and benefits
- Open and transparent compensation philosophy
- Pay bands designed for competitive and equitable compensation
- Globally distributed remote work arrangement
- Flexible location options in almost any part of the world
- Equal opportunity workplace
Similar Jobs
ML Ops Engineer
ML Ops Engineer productionizing reliable, observable machine-learning systems for Nift’s performance-marketing platform. Building cloud infrastructure, deployment pipelines, monitoring, and model governance.
Senior Machine Learning Engineer
Senior Machine Learning Engineer productionizing computer vision models for Samsara’s IoT-powered Connected Operations Cloud. Building low-latency APIs, data pipelines, and monitoring for fleet-scale safety features.
Junior AI/ML Engineer, GenAI, AWS
Junior AI/ML Engineer building RAG, GenAI, and AWS systems for Provectus, an AWS Premier and Anthropic Strategic Partner. Contributing to production AI, backend services, evaluations, and deployments.
Mid-Level MLOps Engineer
MLOps Engineer building and operating secure, reliable ML/AI production services for Redcare Pharmacy, Europe’s leading e-pharmacy. Improving Python systems, Kubernetes infrastructure, CI/CD, and model lifecycle practices.
Machine Learning Engineer – Roleplay Sessions
Machine Learning Engineer building real-time AI coaching for Synthesia’s interactive enterprise roleplay training platform. Developing performance scoring, feedback, and avatar-response models.
AI, Machine Learning Roles
AI/ML professionals developing Generative AI and machine learning solutions. Building scalable cloud applications with Python, LLMs, data pipelines, APIs, and microservices.
Senior AI/ML Engineer – India
Forward Deployed AI/ML Engineer developing and deploying models, LLMs, and Agentic AI systems for NewRocket’s enterprise ServiceNow clients. Building scalable cloud, data, and automation solutions.
Staff Machine Learning Engineer
Staff ML Engineer setting technical direction for AI models at Payabli, a payments infrastructure platform. Building, deploying, and monitoring models across risk, authorization, disputes, and payouts.
Senior Machine Learning Engineer, Forecasting
Senior ML Engineer building MLOps and forecasting infrastructure for Apella’s surgical-care technology. Automating retraining, deployment, monitoring, and scalable production ML systems.
Machine Learning Engineer
Machine Learning Engineer building efficient, production-grade ML models for Proofpoint’s AI-powered cybersecurity detections. Optimizing transformer and LLM systems for reliable, scalable threat protection.
Senior Machine Learning Engineer
Machine Learning Engineer building secure ML platforms, computer vision systems, and AI microservices. Supporting Odyssey’s defense, ISR, and warfighter readiness capabilities.
Senior ML Engineer – Client Solutions
Senior ML Engineer delivering production forecasting and detection systems for AZX’s climate and sustainability clients. Building data pipelines, APIs, monitoring, and client-environment deployments.
Principal Machine Learning Engineer
Principal ML Engineer building Zillow’s multimodal AI agents for real estate customers. Developing Voice AI, Deep Research, evaluation frameworks, and scalable agent infrastructure.
Senior AI/ML Engineer
Senior AI/ML Engineer architecting enterprise Agentic AI orchestration platforms for IT services. Building modular agent workflows with Claude, LangGraph, RAG, vector databases, and FastAPI.
Senior Machine Learning Engineer II
Senior Machine Learning Engineer building large-scale predictive models for FlightAware’s aviation intelligence products. Improving flight arrival, landing, and taxi-time predictions for airlines and airports.
GPU MLOps Engineer
GPU MLOps Engineer managing Azure GPU infrastructure, ML deployments, security, and cloud costs for Molex, a global electronics solutions supplier.
Head of Applied Machine Learning – Application Fraud
Head of Applied ML leading fraud detection and identity models at SentiLink, an identity and risk solutions company. Managing scientists and driving production ML strategy across financial-risk products.
Applied Machine Learning Manager – Application Fraud
Applied ML Manager leading teams developing fraud detection and identity verification models at SentiLink. Owning production ML, risk analysis, and product strategy for U.S. financial systems.
Machine Learning Engineer
Machine Learning Engineer building physics-informed surrogate models for Molex’s electronic connectors and interconnect solutions. Accelerating engineering design optimization through Azure ML and GPU-based simulation prediction.
Staff Machine Learning Engineer, Supply
Staff ML Engineer leading forecasting, supply positioning, and fleet optimization systems. Shaping technical strategy for Lime’s shared micromobility platform serving cities worldwide.