Principal Software Engineer – Dynamo
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Principal Software Engineer on the Dynamo project developing scalable inference for AI at NVIDIA. Addressing challenges in distributed AI infrastructure and building next-gen AI systems.
Responsibilities:
- Collaborate on the design and development of the Dynamo Kubernetes stack
- Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library
- Design, implement, and optimize distributed inference components in Rust and Python
- Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs)
- Improve intelligent routing and KV-cache management subsystems
- Contribute to open-source repositories, participate in code reviews, and assist with issue triage on GitHub
- Work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture
- Write clear documentation and contribute to user and developer guides.
Requirements:
- BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience)
- 15+ years of proven experience in related field
- Strong proficiency in systems programming (Rust and/or C++)
- Experience in Python for workflow and API development
- Experience with Go for Kubernetes controllers and operators development
- Deep understanding of distributed systems, parallel computing, and GPU architectures
- Experience with cloud-native deployment and container orchestration (Kubernetes, Docker)
- Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads
- Background with memory management, data transfer optimization, and multi-node orchestration
- Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment)
- Excellent problem-solving and communication skills.
Benefits:
- Highly competitive salaries
- Comprehensive benefits package
- Equity
- Health insurance
- Paid time off
- Professional development opportunities
Similar Jobs
Software Engineer – Co-Ops
Software Engineer focusing on building new features for clinical research data management platform. Collaborating with teams in an agile environment to enhance software functionality.
Junior Full Stack Developer
Junior Full Stack Developer involved in designing and maintaining digital solutions for the health sector. Collaborating in a full stack development team while managing AWS infrastructure and CI/CD workflows.
Full Stack Developer
Full Stack Developer designing and maintaining features for digital solutions in health and social care. Engaging in collaborative development to enhance user experiences and system performance.
Senior Software Engineer – Full Stack
Senior Software Engineer developing user interfaces and backend services for Button’s commerce platforms. Utilizing React, TypeScript, and working in a collaborative engineering environment.
Senior Software Engineer
Senior Software Engineer with expertise in Salesforce, NetSuite, and Python-based services at Meteor Education. Contributing to scalable software solutions and technical architecture.
Software Engineer L4
Software Engineer L4 responsible for designing and implementing features for Funnel's CRM software. Working with product managers and engineers in a remote environment focused on innovating the rental experience.
Senior Software Engineer
Senior Software Engineer supporting applications for Savannah River Site from Aiken, SC. Responsible for testing upgrades, troubleshooting issues, and application development lifecycle management.
Senior/Staff Software Engineer, OfficeJs
Senior/Staff Software Engineer developing AI-powered Microsoft Office integrations. Leading technical direction for a key product transforming legal workflows.
Staff Software Engineer – Canvas Core
Staff Software Engineer ensuring Mural’s editor is reliable and high-performing, featuring developer-friendly APIs and real-time collaboration tools.
Senior Software Engineer, Web Experience
Senior Software Engineer developing robust web applications for a global commerce platform. Collaborating with cross-functional teams to enhance user experience and maintain high-quality standards.
Software Engineer
Software Engineer developing and implementing software solutions for S&P Global Energy's analytics platform. Collaborating with an Agile team to meet customer requirements and deliver quality software.
Software Engineer – Full Stack
Full Stack Software Engineer developing and managing systems for modern wellness and fitness platform. Collaborating with product teams and technical ownership in a growing startup environment.
Principal Software Engineer
Principal Software Engineer at Demandbase focusing on scalable systems and architectural leadership. Collaborating on AI-driven B2B growth solutions and mentoring engineering talent.
Senior Software Engineer
Software Engineer maintaining web applications for Motorola Solutions with a focus on LPR data services. Collaborating closely with product managers and developers to improve existing systems and features.
Tech Lead
Tech Lead position at Verity focusing on architecture of AI agents. Leading hands-on development in Python and integrating with SAP.
Senior FullStack Developer
FullStack Developer creating and evolving digital solutions with AI agents for Verity's projects. Engaging in both frontend and backend development with robust integration capabilities.
Lead Software Developer
Lead Software Developer at SANS Institute, designing and developing e-learning and cybersecurity training platforms. Combining technical expertise with strategic vision for robust digital solutions.
Staff Software Engineer, Web Experience
Staff Software Engineer developing web applications for Mobility solutions. Join us to enhance customer experience for transportation companies with strong frontend expertise and full-stack exposure.
Senior Software Engineer – React Native
Senior Software Engineer developing React Native applications for Kraken to enhance user onboarding and experience. Collaborating with teams to optimize activation processes and mentor engineers in the field.
Senior Software Engineer – Platform Services
Senior Software Engineer for Delinea, developing secure cloud-based solutions. Collaborating on microservices using C# .NET and driving innovation in AI-assisted automation.