Principal Software Engineer – Rack Scale Systems Infrastructure
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Principal Software Engineer at NVIDIA building software systems for rack-scale infrastructure capabilities. Collaborating across teams to develop dependable, manageable, and programmable solutions for AI-powered applications.
Responsibilities:
- Define the complete software architecture for rack-scale infrastructure products and services, covering control plane services, infrastructure management, firmware, operating systems, kernel drivers, networking fabrics, accelerator software, and user-mode manageability software.
- Use Kubernetes and cloud-native primitives as an infrastructure fabric when appropriate. This includes controllers, operators, reconciliation loops, and open source components. These components can operate safely at rack and fleet scale.
- Build open source infrastructure software that can be embraced in different forms, including libraries, services, controllers, operators, and integration APIs for internal deployments and CSP environments.
- Bridge hardware and software teams across firmware, BMC, BIOS, boot flows, OS images, drivers, networking, NVLink domains, InfiniBand, GPUs, DPUs, CPUs, and system management interfaces.
- Translate forward-looking infrastructure roadmaps into formal software requirements, architecture specifications, and execution plans that align teams across the organization.
- Partner directly with hyperscalers, CSPs, enterprise customers, internal component leads, vendors, and business partners to align infrastructure capabilities with real-world deployment and integration needs.
- Establish reliability, security, validation, and left-shift strategies that reduce risk before hardware reaches production environments.
- Mentor senior engineers and technical leads, raising the engineering bar for large-scale networked systems, foundational software, and rack-scale control plane development.
- Make high-quality technical decisions in ambiguous environments, balancing customer needs, schedule, hardware realities, software maintainability, open source adoption, and long-term infrastructure evolution.
Requirements:
- BS or MS in Computer Engineering, Computer Science, Electrical Engineering, or a related field, or equivalent experience.
- Proven experience (15+ years) in systems architecture, system software, distributed systems, infrastructure control planes, or infrastructure engineering.
- Solid architectural knowledge of coordination frameworks, state machines, declarative APIs, reconciliation loops, lifecycle orchestration, failure handling, upgrade and rollback workflows, and distributed systems tradeoffs.
- Practical coding skills in Go, C++, or Rust, encompassing the capability to write, review, and direct production-quality infrastructure software.
- Experience with Rust is highly valued.
- Experience with Kubernetes or similar orchestration systems, especially as a fabric for managing infrastructure, hardware resources, or large-scale infrastructure services.
- Experience with Linux-based infrastructure software, OS rollout and image management, kernel or driver interactions, firmware lifecycle, and hardware bring-up workflows.
- Strong understanding of data center networking technologies and protocols, such as Ethernet, InfiniBand, RDMA, and fabric-level manageability.
- Experience with complex accelerator-based systems, including GPUs, DPUs, FPGAs, custom silicon, or other high-performance computing systems.
- Expertise in in-band and out-of-band management architectures, including BMCs, Redfish, IPMI, and related system management protocols.
- Ability to work with security experts to define practical tradeoffs across secure boot, attestation, access control, update safety, serviceability, and ease of operation.
- Experience crafting software intended for open source release, including API stability, modularity, documentation, community usability, and clean separation between shared software and deployment-specific integrations.
- Experience using AI-assisted development tools responsibly as an engineering multiplier for coding, test generation, debugging, build iteration, and documentation.
- Established skill in specifying requirements, guiding architecture, and managing delivery across various engineering teams and organizations.
- Strong written and verbal communication skills, enabling clear explanation of complex hardware/software tradeoffs to engineering leaders, customers, partners, and executives.
Benefits:
- equity
- benefits
Similar Jobs
Junior Software Engineer
Junior Software Engineer developing Cloud SaaS applications for Trimble. Building technology that connects the lifecycle of public infrastructure.
AI Software Engineer
AI Software Engineer working to modernize development lifecycle and build scalable Cloud SaaS applications at Trimble. Engaging with AI tools to improve infrastructure efficiency.
Forward-Deployed Software Engineer
Forward-Deployed Software Engineer developing analytics and software tools to bridge client-facing teams and engineering at Anomaly. Collaborating closely with data science and engineering teams to implement solutions.
Principal Software Engineer
Principal Software Engineer developing scalable AWS cloud-native SaaS solutions for secure internet connectivity. Leading architectural strategy and mentoring teams to innovate and implement best practices in engineering.
Software Engineer, User Operations
Software Engineer for User Operations building AI systems that improve product quality and customer feedback integration. Collaborate with internal teams to deliver effective technical solutions for product insights.
Engenheiro de Software
Software Engineer focusing on Java development and high availability systems. Engaging in incident resolution and improving client experience for financial solutions.
Technical Lead – Onboard Systems
Technical Lead managing perception technology and planning systems for autonomous mining trucks. Responsible for project management, development work, and team collaboration in engineering.
Senior Systems Software Engineer, CUDA GPU Profiler
Senior Systems Software Engineer developing innovative technologies for GPU performance profiling at NVIDIA. Collaborating with multiple teams to enhance tool capabilities for CUDA developers worldwide.
Senior Software Engineer, AI Performance Analysis
Senior Software Engineer creating tools to optimize AI performance analysis for NVIDIA. Collaborating with engineers and architects to develop scalable workflows for AI workloads.
Staff Engineer, Systems & Integrations
Staff Engineer shaping internal systems and integrations at Makeship. Collaborate to enhance processes and deliver technical solutions.
Senior Software Architect
Senior Software Architect designing software architecture at Nagel-Group. Collaborating with stakeholders and implementing architecture standards in logistics software development.
Senior Cloud IoT Software Engineer
Senior Engineer, Backend / Cloud designing and scaling cloud-native backend services at Carrier. Leading technical execution and improving platform reliability in the role.
Arquiteto de Software
Software Architect at Lumis focusing on enhancing digital solutions and leading technical implementations. Collaborating with teams to ensure quality, performance, and security in technology projects.
Staff Engineer – AI-Native
Staff Engineer leading technical direction across front-end and back-end systems for AI-native learning platform at Nerdy. Mentoring engineers and driving scalable, secure user experiences.
Full Stack Developer
Software Engineer I building web application features at Carrier. Focus on frontend delivery and backend integrations for the Connected Portal.
Software Engineer, Infrastructure
Software Engineer responsible for designing, building, and operating systems at Anrok. Collaborate with teams to enhance the reliability and performance of tax automation infrastructure.
Principal Engineer, Testing
Principal Test Engineer developing and designing tests for PLM software quality at Northrop Grumman. Collaborating with teams to ensure software reliability and quality across various platforms.
Full Stack Engineer
Full Stack Engineer developing responsive web applications using TypeScript and collaborating with cross-functional teams. Contributing to all stages of the Software Development Lifecycle in a remote-first environment.
Principal Software Developer
Software Developer Principal at GDIT developing mission-critical applications for government projects. Engaging in the complete software lifecycle from design to implementation and support.
Staff Software Engineer
Staff Software Engineer developing innovative real-time care intelligence solutions at Bamboo Health. Collaborating on high-impact projects and enhancing workflows through technology advancements.