Senior Systems Software Engineer – Accelerated Spark Applications
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior engineer building NVIDIA’s GPU-accelerated Apache Spark services on Kubernetes. Extending Spark runtimes, workload routing, and production data-platform infrastructure.
Responsibilities:
- Design, build and operate a hosted Spark service control plane on Kubernetes, including the Java REST API, Spark Connect runner, Kyuubi, and deployment using Helm charts and Flux
- Own code review for one or more services end to end and keep them releasable on the release train
- Extend the cuDF Spark runtime and CPU/GPU workload router in Scala and Java, including interoperability with Delta Lake, Apache Iceberg and Unity Catalog
- Investigate production failures on clusters running more than a thousand concurrent jobs with customer and upstream library teams, and drive fixes to closure
- Instrument metrics, dashboards and alerts; participate in the on-call rotation and maintain runbooks
- Provide recommendations and feedback on infrastructure, continuous integration, and testing strategy decisions
Requirements:
- BS, MS, or PhD in Computer Science, Computer Engineering, or a closely related field (or equivalent experience)
- 9+ years of experience in software development
- Strong distributed-systems fundamentals
- Proficiency in Java or Scala, plus C++ or Python
- Hands-on experience operating services on Kubernetes, on-premise or cloud
- Experience owning or reviewing a long-lived server, including REST front ends, proxies or request routers, JDBC or Thrift services
- Experience supporting enterprise or internal production customers, including on-call
- Experience using AI tools in software development
Benefits:
- Equity
- Comprehensive benefits package
Similar Jobs
Full Stack Developer, Java, Angular
Full Stack Developer desarrollando soluciones Java y Angular para proyectos de transformación digital de knowmad mood. Trabajo remoto en España con tecnologías de microservicios y frontend Angular.
Software Engineer, German Energy Market Processes
Software Engineer building German Grundversorgung, billing, and EDIFACT market-communication systems. Supporting principal33’s end-to-end energy supplier platform for regulated utility processes.
Senior Software Engineer, AML Team
Senior Software Engineer building TypeScript AML services and Admin Panel features for SEON’s fraud-prevention platform. Leading technical design, delivery, reliability and mentoring.
Software Engineer, AML Team
Software Engineer building TypeScript AML services for SEON’s fraud prevention platform. Delivering secure, scalable features across case management, customer-facing tools and compliance datasets.
Full Stack Developer, Java/Angular
Full Stack Developer Java/Angular desarrollando soluciones de transformación digital para knowmad mood. Trabajo remoto con Java, Spring Boot, microservicios y Angular.
Software Engineer Co-op
Part-time Software Engineer co-op at Raytheon, an aerospace and defense company, completing training and clearance activities remotely. Converting to onsite systems engineering work after graduation and clearance approval.
Software Developer – Must own MacBook
Software developer completing and narrating coding tasks for Mercor’s AI-model training projects. Building, debugging, refactoring, and reviewing code remotely on a personal Mac.
Product Engineer – Passport
Product Engineer building WorkOS Passport onboarding and access-management experiences. Shaping secure identity workflows for employees, administrators, and AI agents.
Senior Software Engineer, Streaming Infrastructure
Senior Software Engineer building Airbnb's CDC and batch data platforms. Operating reliable, large-scale infrastructure that powers data movement across the company's systems.
Senior Software Engineer
Senior Front-End Software Engineer building accessible web applications for the Department of Veterans Affairs. Integrating AI-driven insights, REST APIs, and cloud services into secure user experiences.
Principal Engineer
Principal Engineer leading remedial system design and technical delivery for EHS Support’s environmental consulting clients. Supporting permitting, project management, business development, and staff mentorship.
Senior Principal Software Engineer
Senior Principal Software Engineer researching AI-powered prototypes for Clarity Innovations’ national-security and defense platforms. Designing proofs of concept and delivering secure, tested software capabilities.
Odoo Software Engineer
Odoo Software Engineer building and maintaining Miratech’s finance and project-management systems. Developing custom modules, integrations, data migrations, and testing pipelines for global clients.
Odoo Software Engineer
Odoo Software Engineer building Miratech’s Odoo finance and project-management systems. Developing integrations, data migrations, testing pipelines, and custom applications.
Odoo Software Engineer
Odoo Software Engineer developing Miratech’s finance and project-management systems. Building custom modules, integrations, data migrations, and testing pipelines on Odoo 20.
Odoo Software Engineer
Odoo Software Engineer building and integrating Miratech’s finance and project-management systems. Developing custom modules, data migrations, testing pipelines, and banking integrations.
Odoo Software Engineer
Odoo Software Engineer developing finance and project-management customisations for Miratech, a global IT services and consulting company. Building integrations, data migrations, and testing pipelines.
Linux Web Server Administrator
Linux Web Server Administrator managing Apache, Tomcat, NGINX, and RHEL environments for DecisionPoint. Supporting secure production systems, troubleshooting performance issues, and remediating vulnerabilities.
Director, Software Engineering – Platform Development
Platform engineering director leading UBC’s Microsoft-based platform modernization for pharmaceutical support and drug development services. Building secure, scalable, AI-enabled solutions in a regulated healthcare environment.
Director, Software Engineering – Platform Development
Director leading UBC’s Microsoft platform engineering, enterprise architecture, and AI-enabled solutions. Advancing secure, scalable technology for pharmaceutical development and healthcare outcomes.