DevOps Engineer – AI Inference
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
DevOps Engineer designing and maintaining AI inference workloads infrastructure at Gcore. Join a global team to deliver AI-driven solutions in a secure environment.
Responsibilities:
- Design, develop, and maintain infrastructure for AI inference workloads, including GPU scheduling, model deployment pipelines, and data access patterns in on-prem environments
- Build and manage monitoring and observability tools for AI inference platforms, including dashboards, alerts, and runbooks for model health and system performance
- Collaborate with ML engineers and platform teams to design system architecture for AI workloads, integrate inference runtimes, and test performance at scale
Requirements:
- Strong understanding of Kubernetes architecture, including CNI, CSI, operators, ingress/gateway, and control plane components.
- Hands-on experience operating and troubleshooting production Kubernetes clusters.
- Strong Linux and networking troubleshooting skills, including DNS, routing, firewalling, TLS, MTU, connectivity and performance issues.
- Ability to develop automation and operational tooling using Python, Go, or Bash.
- Experience with Terraform, Ansible, or similar IaC/configuration management tools.
- Experience with VictoriaMetrics/Grafana or similar monitoring, alerting, and troubleshooting tools.
- Strong experience with Git-based workflows and CI/CD pipelines.
- Familiarity with Cluster API or similar Kubernetes cluster lifecycle management technologies.
- Hands-on operation or administration of Slurm clusters.
- Knowledge of Argo CD, GitOps workflows, Helm, or Helmfile.
- Background working with managed platforms, PaaS, or cloud services.
- Exposure to bare metal, GPU, HPC, or other high-performance computing environments.
- Familiarity with the NVIDIA GPU stack, RDMA/InfiniBand, or high-performance networking.
- Knowledge of OpenStack or similar cloud infrastructure platforms.
- Hands-on experience developing Kubernetes operators or controllers.
Benefits:
- Competitive compensation
- Flexible working hours and hybrid or remote options, depending on your role
- Work from anywhere in the world for up to 45 days per year
- Private medical insurance for you and your family*
- Extra paid vacation and sick leave days*
- Support for life’s important moments and celebrations
- Language courses to help you connect and grow
- Modern, welcoming offices with snacks, drinks, and entertainment*
- Team sports and social activities*
Similar Jobs
Ingeniero/a DevOps – GCP
DevOps Engineer focusing on cloud deployments in Google Cloud Platform, working full-remote in Spain. Seeking experienced candidates with software and infrastructure skills.
DevOps Analyst – Mid-level
DevOps Analyst Pleno responsible for CI/CD pipelines and cloud environment management at a digital consultancy. Focus on automation, monitoring, and infrastructure as code.
Senior DevOps Engineer – WebRTC, LiveKit
Remote Senior DevOps Engineer building infrastructure and CI/CD for real-time applications. Join a dedicated agency specializing in WebRTC and real-time communications.
Senior Software Engineer – NVLink Rack Scale Stability and Reliability
Senior Software Engineer at NVIDIA focusing on NVLink systems stability and reliability. Collaborating with multiple teams on innovative AI infrastructure solutions.
Network Deployment Engineer – Contract
Network Deployment Engineer deploying and validating data center network infrastructure at Fluidstack. Hands-on role requiring travel for onsite deployments and operational support.
Senior DevOps Engineer – UK/Europe Support
Senior DevOps Engineer specializing in cloud infrastructure and automation for UK and European stakeholders. Collaborating within a distributed team to enhance deployment processes and manage infrastructure needs.
Cloud Platform Engineer – Data Reliability, Backing Services
Cloud Platform Engineer focused on data reliability and scalable backing services at Mozn. Join a diverse team shaping the future of AI and intelligent enterprises.
Mid SRE – Cloud Product Reliability
Product Reliability Engineer ensuring cloud products and services are reliable with minimal disruptions. Role involves identifying risks, establishing reliability requirements, and improving system performance.
Senior DevOps Engineer – AWS, Terraform
DevOps Engineer managing infrastructure change requests for healthcare clients. Collaborating with teams while utilizing AWS and Terraform in a fully remote setup.
SRE Production Support
SRE Production Support role in NBCUniversal's AIOps group supporting digital media delivery systems and automation. Collaborate with teams to enhance system reliability and performance.
Site Reliability Engineer
Site Reliability Engineer for PSI ensuring reliability, security, and performance in Federal Government IT solutions. Collaborating with teams to enhance DevOps practices and system health.
DevOps Analyst – Mid-level
DevOps Analyst Pleno role in a digital transformation consultancy. Responsible for CI/CD management and automation in cloud environments.
Senior DevOps Engineer
Senior Developer, DevOps designing and scaling infrastructure at Fullscript. Collaborating with engineering teams to enhance reliability, security, and performance of the platform.
Site Reliability Engineer
Site Reliability Engineer at Pythian, designing and operating large-scale distributed systems. Collaborating with teams to build resilient infrastructure across compute, storage, networking, and AI/ML environments.
Especialista en Azure, Terraform y DevOps
Azure Specialist responsible for designing and implementing secure, scalable cloud infrastructures at IRIUM. Requires proficiency in Azure and Terraform with DevOps practices.
Senior Site Reliability Engineer
Senior Site Reliability Engineer driving reliability initiatives across critical financial services infrastructure. Mentoring engineers and implementing highly available systems with extensive AWS knowledge.
Director, Clinical Development Operations
Director of Clinical Development Operations leading teams at Syneos Health. Responsible for oversight of clinical development and ensuring compliance across studies.
Principal Site Reliability Engineer
Principal Site Reliability Engineer shaping the Kubernetes platform and infrastructure strategy at DraftKings. Leading modernization and reliability initiatives across engineering teams.
DevOps, Freelance
DevOps professional contributing to complex digital projects for various industry clients. Collaborating with multidisciplinary technical teams in Agile contexts.
DevOps Engineer
DevOps Engineer enhancing customer experience at Colonial Surety Company. Responsible for deploying product updates and improving systems through collaboration and project management.