Senior Solutions Architect – Large Scale AI Inference
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Solutions Architect guiding EMEA customers deploying NVIDIA’s large-scale AI inference on GPU clusters. Optimizing MoE serving, interconnect-aware scheduling, and next-generation inference architectures.
Responsibilities:
- Guide EMEA AI Natives customers in deploying and optimizing large-scale inference workloads on multi-node GPU clusters
- Architect efficient inference pipelines for dense and sparse/latent MoE models distributing workload among thousands of GPUs
- Improve inference efficiency across quantization, speculative decoding, disaggregated prefill/decode, KV cache management, and WideEP for large MoE deployments
- Collaborate with NVIDIA product teams, including Dynamo, TensorRT-LLM, and NIXL, to accelerate customer success
- Animate the AI inference developer community across EMEA through technical workshops, hackathons, and reference architectures
- Establish technical direction for scalable, high-performance AI inference across demanding production environments
Requirements:
- MS or PhD in Computer Science, Engineering, High-Performance Computing, or equivalent professional experience
- 5+ years of experience in Neural Networks inference optimization
- Solid understanding of transformers inference optimization, including quantization, disaggregated inference, speculative decoding, continuous batching, and KV cache optimization
- Practical experience in MoE inference at scale, including expert parallelism, WideEP, all-to-all communication, routing overhead, and load balancing at scale
- Ability to engage effectively with ML engineers, researchers, and systems architects at a deep technical level
- Hands-on experience with NVIDIA Dynamo, NIXL, Grove, or emerging disaggregated inference tooling
- Understanding of GPU memory hierarchies and high-speed interconnects, including NVLink, InfiniBand, RDMA, and UCX
- Contributions to advanced AI labs or large-scale AI infrastructure providers performing inference on thousands of GPUs
- Published work or benchmarks in large-scale AI inference
Benefits:
- Highly competitive salaries
- Comprehensive benefits package
Similar Jobs
Senior Solutions Architect – Large Scale Neural Networks Inference
Senior Solutions Architect optimizing large-scale neural network inference for NVIDIA’s EMEA AI customers. Architecting production pipelines and shaping the NVIDIA inference technology roadmap.
Senior Solutions Architect – Multimodal AI
Senior Solutions Architect guiding EMEA AI companies in building production-ready multimodal document, image, and video intelligence solutions with NVIDIA technology.
Senior Solutions Architect – Large Scale AI Training
Senior Solutions Architect guiding EMEA AI model builders on distributed training, alignment, and NVIDIA’s full training stack. Optimizing large-scale foundation-model infrastructure and shaping product roadmaps.
Wealth Solutions Consultant
Wealth Solutions Consultant driving AssetMark’s Private Wealth and investment solutions adoption among independent financial advisors. Managing territory growth through consultative sales, advisor relationships, and wealth strategy support.
Oracle Cloud Solution Architect
Oracle Cloud Solution Architect designing Oracle Fusion HCM integrations and data conversions for CACI’s federal modernization programs. Leading technical delivery, OCI administration, testing, and cutover.
AI Sales Executive – Solutions Engineer
AI sales executive and solutions engineer designing no-code agentic AI workflows for QAD’s manufacturing platform. Selling and configuring solutions that improve procurement and supply-chain outcomes.
Data Solutions Manager – Freelancer
Data Solutions Manager translating client requirements into reporting and BI solutions for Publicis Groupe’s global marketing teams. Overseeing data integrity, dashboards, testing, and delivery.
Solutions Engineer
Solutions Engineer supporting Acronis sales through technical demonstrations, solution design, and cybersecurity advice. Remote role serving customers and partners in Colombia or Peru.
Technical Solutions Consultant – Americas
Technical Solutions Consultant helping Ashby customers configure recruiting software integrations, IAM, and APIs. Bridging Customer Success, Product, Support, and Professional Services through technical delivery.
Quantum Solutions Architect, English Speaker
Quantum Solutions Architect guiding APAC customers through quantum software adoption. Leading technical discovery, demos, and sales-cycle strategy for Classiq’s quantum computing platform.
Solution Engineer, Spanish-speaking
Spanish-speaking Solution Engineer supporting banks and fintechs using Moneythor’s digital banking platform. Customizing implementations, resolving technical issues, and driving client adoption.
Executive Assistant, VP, Sales Solution Engineering
Executive Assistant supporting Cisco’s VP of Sales Solution Engineering. Managing calendars, executive travel, events, communications, and special projects for global networking sales.
Senior Robotics Solutions Engineer
Senior Robotics Solutions Engineer integrating industrial robots with PackageX’s physical logistics platform. Designing safe palletizing and sortation systems for enterprise distribution centers.
Project Manager – Banking Software Implementation
Project Manager leading CRM onboarding, upgrades, and change requests for Navanta's community bank technology solutions. Coordinating customer-facing projects across scope, budget, timelines, and stakeholders.
Client Solutions Manager
Client Solutions Manager leading multi-program client portfolios for Mosaic, a sales and marketing agency. Growing pilots and seasonal engagements into profitable, ongoing brand programs.
Solutions Architect II
Solutions Architect II designing secure, scalable cloud and MarTech architectures. Helping Homera Health expand its D2C telemedicine brands through integrations, documentation, and technical leadership.
Manager, Solutions Engineering – Commercial
Manager leading commercial Solutions Engineering teams at Talkdesk, an AI-powered customer experience automation company. Driving presales strategy, customer adoption, revenue growth, and team development.
Partner Solutions Engineer
Partner Solutions Engineer enabling DevRev’s AI-powered work platform through resellers, OEMs, integrators, and alliances. Leading technical presales, solution design, partner training, and co-selling.
Senior Solutions Engineer – US Federal
Senior Solutions Engineer helping Coder sell secure AI development infrastructure to federal agencies. Leading demos, deployments, and proofs-of-concept in classified and air-gapped environments.
Financial ERP Oracle Functional Solutions Architect
Oracle architect designing scalable Fusion Cloud ERP and ORMB solutions for Navitus, a pharmacy benefit manager. Leading finance, billing, integration, reporting, and platform governance initiatives.