AI Platform Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Platform Engineer developing sovereign LLM hosting, RAG, and Kubernetes infrastructure. Shaping secure AI platforms at German IT services provider DATAGROUP.
Responsibilities:
- Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure
- Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking
- Ensure cost control, tenant isolation, data protection, and guardrails
- Establish monitoring and observability for the performance, quality, and usage of AI services
- Further develop the container-based platform using Docker, Coolify, and Kubernetes
- Automate deployments and take responsibility for CI/CD processes for in-house development projects
- Manage Linux, cloud, and database infrastructure while ensuring stability, security, and availability
- Build and enhance monitoring, logging, and alerting solutions
- Actively shape the architecture of platform and AI services
- Establish Infrastructure as Code and standardized deployment processes
- Ensure data protection-compliant and tenant-secure operating models
- Document solutions, share knowledge within the team, and evaluate new technologies in platform engineering and AI
Requirements:
- Degree in computer science, business informatics, or a comparable qualification
- Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments
- Solid hands-on experience operating container-based applications and modern platforms
- Experience building and operating LLM and AI services in production, ideally in self-hosted environments
- Very good knowledge of Kubernetes, Docker, and Linux
- Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL
- Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions
- Solid Python skills for automation and integrations
- Independent, structured working style with a high degree of ownership, along with a strong awareness of security and data protection
- Strong understanding of architecture and platform engineering
Benefits:
- Open and collaborative company culture
- Trust-based working environment
- Comprehensive onboarding with support from the entire AIS team
- Flat hierarchies, short decision-making processes, and a high degree of freedom to shape your work
- Strategic role with significant influence over the future platform landscape
- Opportunity to work on sovereign LLM hosting and AI infrastructure
- Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies
- Opportunity to actively shape standards, processes, and architectural decisions
- Individual professional development budget for conferences, certifications, and specialized training
- Clear career and development paths
- Opportunity to specialize as an AI Platform Engineer or LLMOps expert
- Small, focused, and agile team with short decision-making processes
- Open feedback culture with regular one-to-one meetings and retrospectives
Similar Jobs
Manager II, Platform Engineering – Compute
Platform Engineering Manager leading Kubernetes and AWS compute infrastructure for Housecall Pro, whose software helps home-service professionals manage scheduling, dispatching, and payments.
Platform Engineer
Platform Engineer building and running Holistic AI’s AI governance SaaS platform. Developing TypeScript, React, cloud infrastructure, and LLM-powered features for enterprises.
Associate DevSecOps Engineer, Platform and Tooling
Associate DevSecOps Engineer building AbbVie’s enterprise Application Security program. Integrating AST tools into CI/CD pipelines to secure software delivering innovative medicines.
Systems Engineer – Platform Deployment Operations
Systems Engineer deploying SPHEREboard identity-hygiene platforms across regions and secure zones. Maintaining infrastructure, integrations, permissions, networking, and data quality for global enterprise clients.
Senior Web Platform Developer
Senior Web Platform Developer building scalable web platforms for Dexcom’s continuous glucose monitoring products. Leading architecture, cloud delivery, CI/CD, and technical mentoring.
Part Time Software Platform Engineer Co-Op
Software Platform Engineer co-op supporting Raytheon’s aerospace and defense systems. Participating in training, security clearance activities, seminars, and mentorship remotely.
Part Time Software Platform Engineer
Part-time Raytheon Software Platform Engineer Co-Op supporting secure aerospace and space-intelligence systems remotely. Transitioning to full-time onsite systems engineering in Aurora after graduation and clearance approval.
Senior Kubernetes Platform Engineer – Consultant
Senior Kubernetes Platform Engineer und Consultant für Cloud-, Hybrid- und On-Premises-Plattformen. Beratung, Implementierung und Modernisierung von Kubernetes-Umgebungen bei evoila Frankfurt GmbH.
Senior Staff Platform Engineer
Senior Staff Platform Engineer owning Azure cloud, data pipelines, and deployment systems. Building reliable infrastructure for Terzo’s enterprise AI and Financial Intelligence Graph platform.
Senior Salesforce Platform Engineer
Senior Salesforce engineer delivering secure CRM, integration, and automation solutions for VIATEQ’s federal government customers. Supporting governed platform development, testing, troubleshooting, and sustainment.
Senior AWS Platform Engineer
Senior AWS Platform Engineer designing AWS, Kubernetes and Terraform platforms. Enabling engineering teams to self-serve reliable, observable production infrastructure.
Senior AWS Platform Engineer
Senior AWS Platform Engineer building scalable AWS and Kubernetes platforms for engineering teams. Automating infrastructure, GitOps delivery, observability, and cloud operations.
Senior AWS Platform Engineer
Senior AWS Platform Engineer building AWS, EKS, Terraform and GitOps platforms. Enabling engineering teams to self-serve reliable, secure production infrastructure.
Senior AWS Platform Engineer
Senior AWS Platform Engineer building AWS, Kubernetes and Terraform platforms for engineering teams. Automating delivery, reliability and observability across production cloud infrastructure.
Senior AWS Platform Engineer
Senior AWS Platform Engineer designing AWS, Kubernetes and Terraform platforms. Enabling engineering teams to self-serve through reliable, observable GitOps infrastructure.
Partner IAM – Security Platform Engineer
IAM Security Platform Engineer modernizing Ford’s B2B identity platform. Building Microsoft Entra, Java, Spring Boot, and API solutions for dealers, suppliers, and partners.
Director, Platform Engineering
Director of Platform Engineering owning Azure infrastructure, CI/CD, and reliability for Aline’s connected resident-care platform. Leading modernization, security, cost optimization, and the platform engineering team.
Senior AI Platform Engineer
Senior AI platform engineer operating gateways, MCP services and observability for Technosylva’s wildfire-management software. Building secure, cost-aware production AI infrastructure.
Staff AI Platform Engineer
Staff AI Platform Engineer owning gateways, agent orchestration, governance, and observability. Building AI infrastructure for Technosylva’s wildfire and natural-hazard management software.
Platform Engineer – III
Platform Engineer III projetando infraestrutura cloud, Kubernetes e observabilidade para o ecossistema de beleza do Grupo Boticário. Automatizando plataformas escaláveis com Terraform, GitOps e AWS.