Senior Research Engineer – Enterprise Products
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Research Engineer designing and evaluating routing policies for AI inference at NVIDIA. Collaborating with engineering teams to integrate software across NVIDIA's serving stack.
Responsibilities:
- Design and evaluate routing policies for LLM traffic to best use mixture of model systems.
- Build and run agentic benchmarks (e.g., Terminal-Bench ) to measure algorithm quality, and turn results into calibration data and routing profiles.
- Ship to an open-source repo: design docs, code review, docs, and community contributions.
- Collaborating with engineering teams across all of NVIDIA to ensure our software integrates seamlessly up and down the NVIDIA accelerated serving stack.
Requirements:
- Bachelor's of Master's degree in Computer Science or equivalent experience.
- 8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow).
- Experience designing or running LLM evaluations/benchmarks — ideally agentic ones — and drawing statistically sound conclusions from them.
- Understanding of modern techniques in Machine Learning, Deep Neural Networks, Natural Language Processing, or Speech Recognition.
- Empirical research mindset: forming hypotheses about new algorithms, running calibrations, iterating on results.
- Strong communication and interpersonal skills, along with the ability to work in a dynamic and distributed team.
- A history of mentoring junior engineers and interns is a huge plus.
- A desire to constantly grow and learn new things.
- Strong computer science fundamentals - algorithms and data structures, computational complexity, parallel and distributed computing, system software.
Benefits:
- eligible for equity and benefits
Similar Jobs
Research Engineer – Level 4
Research Engineer developing LLM/ML evaluation and simulation systems for Netflix’s member understanding. Shaping personalization investments through scalable research, algorithms, and cross-functional collaboration.
Senior Vulnerability Research Engineer
Senior Vulnerability Research Engineer at Nightwing, using advanced systems to find zero-day vulnerabilities. Collaborating on software development and vulnerability research techniques.
Senior Machine Learning Research Engineer – Benchmarking, Paper Replication
Senior Machine Learning Research Engineer at Avenga examining and validating ML methodologies in an R&D environment. Collaborating with engineers and researchers to build practical prototypes.
AI Safety Argumentation Research Engineer
Research Engineer developing and operating systems for AI risk management and safety. Building ontologies and argumentation frameworks for stakeholder communication.
Research & Innovation Engineer
Research & Innovation Engineer at IS-Wireless working on ultra-resilient connectivity in 5G/6G. Collaborating on cutting-edge research and algorithm development with an international team.
Adversarial AI, Research Engineer
Adversarial AI & Research Engineer at Salesforce ensuring AI security through innovative testing methodologies. Leading red team assessments and building security tools for AI systems.
Ice Cream Innovation Engineering Associate Director
Lead engineering execution of product and process innovation at Magnum Ice Cream Company. Collaborate across teams to transform concepts into scalable production-ready solutions.
Machine Learning Research Engineer
Machine Learning Research Engineer developing methods at Roboflow for impactful AI solutions, contributing to research and translating methodologies into scalable systems.
Conversational Modelling Research Engineer
AI Researcher developing foundational multimodal conversational models at Tavus, pioneering human computing. Conducting research, developing methods, and collaborating with teams.
Technical Operations & Innovation Engineer
Technical Operations & Innovation Engineer focusing on integration of technical innovations in infrastructure. Collaborating with the development team and leading initiatives in DevOps and automation.
Malware Research Engineer
Malware Research Engineer investigating cybersecurity threats and developing detection rules at Malwarebytes. Engaging in research and customer inquiry resolution in a dynamic threat landscape.
Malware Research Engineer
Malware Research Engineer analyzing and investigating emerging cyber threats for Malwarebytes. Collaborating with teams to develop detection rules and improve protection technologies.
Research Engineer – Machine Learning Systems
Machine Learning Engineer at Deepgram prototyping novel modeling ideas to build scalable speech technologies. Collaborate with researchers to develop world-class speech recognition and synthesis systems.
No more related jobs available.