Senior Solutions Architect – Large Scale Neural Networks Inference
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Senior Solutions Architect optimizing large-scale neural network inference for NVIDIA’s EMEA AI customers. Architecting production pipelines and shaping the NVIDIA inference technology roadmap.
Responsibilities:
- Lead the inference strategy for a portfolio of EMEA AI Natives customers, guiding engagements from initial proof of concept to production-scale deployments
- Identify inference challenges across customer deployments, including latency, efficiency, cost per token, memory utilization, and low-latency networking
- Architect and optimize high-performance inference pipelines using NVIDIA Dynamo, TensorRT-LLM, vLLM, SGLang, and other inference backends
- Improve GPU utilization and AI cluster efficiency
- Translate customer insights and deployment patterns into actionable product feedback
- Develop the roadmap for the NVIDIA stack, including Dynamo, TensorRT-LLM, and NIM
- Define the technical direction for AI inference across EMEA
- Align NVIDIA and customer organization stakeholders to influence strategic technology decisions for next-generation AI inference at scale
Requirements:
- MS or PhD in Computer Science, Engineering, or equivalent experience in the field
- 8+ years in AI/ML infrastructure, with deep expertise in LLM/VLM inference optimization and production deployment at scale
- Deep understanding of transformer inference acceleration: quantization (INT4/FP8), speculative decoding, disaggregated inference, continuous batching, KV cache optimization, and WideEP for MoE models
- Understanding of GPU memory hierarchies and low-latency networking and their influence on inference performance
- Proven track record to lead technical initiatives
- Excellent communication skills, effective with research scientists, infrastructure engineers, and executive team members
- Experience with NVIDIA's inference stack, including TensorRT-LLM, Triton Inference Server, NIM, and NVIDIA Dynamo
- Experience with GPU orchestration on Kubernetes
- Experience operating inference at scale inside a frontier AI lab or hyperscale's inference team
- Contributions to open-source inference projects such as vLLM, SGLang, KServe, or NVIDIA Dynamo
Benefits:
- Highly competitive salaries
- Comprehensive benefits package
Similar Jobs
Senior Solutions Architect – Multimodal AI
Senior Solutions Architect guiding EMEA AI companies in building production-ready multimodal document, image, and video intelligence solutions with NVIDIA technology.
Senior Solutions Architect – Large Scale AI Training
Senior Solutions Architect guiding EMEA AI model builders on distributed training, alignment, and NVIDIA’s full training stack. Optimizing large-scale foundation-model infrastructure and shaping product roadmaps.
Senior Solutions Architect – Large Scale AI Inference
Senior Solutions Architect guiding EMEA customers deploying NVIDIA’s large-scale AI inference on GPU clusters. Optimizing MoE serving, interconnect-aware scheduling, and next-generation inference architectures.
Wealth Solutions Consultant
Wealth Solutions Consultant driving AssetMark’s Private Wealth and investment solutions adoption among independent financial advisors. Managing territory growth through consultative sales, advisor relationships, and wealth strategy support.
Oracle Cloud Solution Architect
Oracle Cloud Solution Architect designing Oracle Fusion HCM integrations and data conversions for CACI’s federal modernization programs. Leading technical delivery, OCI administration, testing, and cutover.
AI Sales Executive – Solutions Engineer
AI sales executive and solutions engineer designing no-code agentic AI workflows for QAD’s manufacturing platform. Selling and configuring solutions that improve procurement and supply-chain outcomes.
Data Solutions Manager – Freelancer
Data Solutions Manager translating client requirements into reporting and BI solutions for Publicis Groupe’s global marketing teams. Overseeing data integrity, dashboards, testing, and delivery.
Solutions Engineer
Solutions Engineer supporting Acronis sales through technical demonstrations, solution design, and cybersecurity advice. Remote role serving customers and partners in Colombia or Peru.
Technical Solutions Consultant – Americas
Technical Solutions Consultant helping Ashby customers configure recruiting software integrations, IAM, and APIs. Bridging Customer Success, Product, Support, and Professional Services through technical delivery.
Quantum Solutions Architect, English Speaker
Quantum Solutions Architect guiding APAC customers through quantum software adoption. Leading technical discovery, demos, and sales-cycle strategy for Classiq’s quantum computing platform.
Solution Engineer, Spanish-speaking
Spanish-speaking Solution Engineer supporting banks and fintechs using Moneythor’s digital banking platform. Customizing implementations, resolving technical issues, and driving client adoption.
Executive Assistant, VP, Sales Solution Engineering
Executive Assistant supporting Cisco’s VP of Sales Solution Engineering. Managing calendars, executive travel, events, communications, and special projects for global networking sales.
Senior Robotics Solutions Engineer
Senior Robotics Solutions Engineer integrating industrial robots with PackageX’s physical logistics platform. Designing safe palletizing and sortation systems for enterprise distribution centers.
Project Manager – Banking Software Implementation
Project Manager leading CRM onboarding, upgrades, and change requests for Navanta's community bank technology solutions. Coordinating customer-facing projects across scope, budget, timelines, and stakeholders.
Client Solutions Manager
Client Solutions Manager leading multi-program client portfolios for Mosaic, a sales and marketing agency. Growing pilots and seasonal engagements into profitable, ongoing brand programs.
Solutions Architect II
Solutions Architect II designing secure, scalable cloud and MarTech architectures. Helping Homera Health expand its D2C telemedicine brands through integrations, documentation, and technical leadership.
Manager, Solutions Engineering – Commercial
Manager leading commercial Solutions Engineering teams at Talkdesk, an AI-powered customer experience automation company. Driving presales strategy, customer adoption, revenue growth, and team development.
Partner Solutions Engineer
Partner Solutions Engineer enabling DevRev’s AI-powered work platform through resellers, OEMs, integrators, and alliances. Leading technical presales, solution design, partner training, and co-selling.
Senior Solutions Engineer – US Federal
Senior Solutions Engineer helping Coder sell secure AI development infrastructure to federal agencies. Leading demos, deployments, and proofs-of-concept in classified and air-gapped environments.
Financial ERP Oracle Functional Solutions Architect
Oracle architect designing scalable Fusion Cloud ERP and ORMB solutions for Navitus, a pharmacy benefit manager. Leading finance, billing, integration, reporting, and platform governance initiatives.