AI Platform Engineer
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
AI Platform Engineer building and operating sovereign LLM platforms, RAG systems, and cloud infrastructure. Shaping AI architecture and CI/CD for German IT services provider DATAGROUP.
Responsibilities:
- Develop and operate a sovereign LLM platform, including an OpenAI-compatible gateway, model serving, and GPU infrastructure
- Implement customer-specific knowledge integrations (RAG) using vector databases, embeddings, and reranking
- Ensure cost control, tenant isolation, data protection, and guardrails
- Establish monitoring and observability for the performance, quality, and usage of AI services
- Further develop the container-based platform using Docker, Coolify, and Kubernetes
- Automate deployments and take ownership of CI/CD processes for in-house developments
- Maintain Linux, cloud, and database infrastructure while ensuring stability, security, and availability
- Build and enhance monitoring, logging, and alerting solutions
- Play an active role in shaping the architecture of platform and AI services
- Establish Infrastructure as Code and standardized deployment processes
- Ensure data protection-compliant and tenant-isolated operating models
- Document solutions, share knowledge across the team, and evaluate new technologies in platform engineering and AI
Requirements:
- Degree in computer science, business informatics, or a comparable qualification
- Several years of experience in DevOps, platform engineering, or cloud/infrastructure environments
- Extensive hands-on experience operating container-based applications and modern platforms
- Experience building and running LLM and AI services in production, ideally in self-hosted environments
- Very good knowledge of Kubernetes, Docker, and Linux
- Experience with CI/CD pipelines, cloud platforms—particularly Azure—and PostgreSQL
- Practical experience with LLM gateways, RAG architectures, vector databases, and model-serving solutions
- Solid Python skills for automation and integrations
- Independent and structured working style, a high degree of ownership, and strong awareness of security and data protection
- Strong architectural and platform expertise
Benefits:
- Open and collaborative company culture and a trusting working environment
- Comprehensive onboarding with support from the entire AIS team
- Flat hierarchies, short decision-making processes, and a high degree of autonomy
- Strategic role with significant influence on the future platform landscape
- Opportunity to work on sovereign LLM hosting and AI infrastructure
- Modern infrastructure featuring Kubernetes, Docker, CI/CD, and cloud technologies
- Opportunity to actively shape standards, processes, and architectural decisions
- Individual professional development budget for conferences, certifications, and specialized training
- Clear career and development paths
- Opportunity to specialize as an AI Platform Engineer or LLMOps expert
- Small, focused, and agile team with short decision-making processes
- Open feedback culture with regular one-to-one meetings and retrospectives
Similar Jobs
Staff Platform Engineer
Staff Platform Engineer building automated platforms, test tooling, and cloud infrastructure for Focus’s civic-tech government projects. Improving delivery, reliability, observability, and compliance.
Lead Platform Engineer
Lead Platform Engineer building Azure Kubernetes Software Factory capabilities for the US Space Force. Leading DevSecOps platforms, CI/CD automation, security, and classified production environments.
Performance Tester / Platform Engineer
Performance Tester/Platform Engineer building automated testing and cloud platforms for GDIT’s US Courts case-management modernization. Monitoring performance, optimizing systems, and supporting secure government workloads.
Collibra Platform Engineer
Collibra Platform Engineer administering Collibra data governance, metadata, lineage, and integrations. Supporting secure IT services for government stakeholders across development, test, and production environments.
Senior Software Engineer – Platform
Senior Software Engineer building secure, scalable Java/AWS platform services for Anvilogic’s AI cybersecurity platform. Supporting authentication, customer data connections, permissions, and enterprise reliability.
Founding Product and Platform Engineer
Founding Product and Platform Engineer building SGS digital products and cloud platforms. Leading full-stack architecture, reusable services, CI/CD, Kubernetes, and observability.
Product and Platform Engineer – AI Native
Founding Product and Platform Engineer building customer-facing products and cloud platforms for SGS, a global testing, inspection, and certification company. Defining architecture, reusable services, and engineering standards.
Founding Product and Platform Engineer
Founding Product and Platform Engineer shaping SGS’s digital products and engineering platform. Building full-stack systems, cloud infrastructure, CI/CD, and reusable capabilities for a global testing and certification leader.
Platform Engineer
Platform Engineer building Kubernetes-based, multi-cloud infrastructure for Ema’s enterprise Agentic AI platform. Owning reliability, observability, distributed systems, and platform services.
Software Engineer – Platform, AI
Platform Software Engineer building Go-based Kubernetes, CI/CD, and data infrastructure for enterprise SaaS. Owning GCP, observability, security, and distributed platform systems.
Power Platform Developer
Microsoft Power Platform Developer designing Power Apps, Power Automate, and Power BI solutions. Improving client processes through automation, analytics, integrations, and legacy application modernization.
Engineer, Platform Tooling
Platform tooling engineer managing monitoring platforms, incidents, and production issues for Presidio’s managed technology services. Supporting enterprise networks, storage, VMware, and observability tools.
Staff ML Platform Engineer
Staff ML Platform Engineer building Datavant’s healthcare data and AI infrastructure. Leading production ML platforms, LLM serving, observability, and regulated-data safeguards.
Director of Platform Security Engineering
Leading platform security strategy and engineering for Pax8’s cloud technology marketplace. Building secure cloud-native development, tooling, metrics, and high-performing security teams.
Senior Varicent Integration – Platform Engineer
Senior Varicent engineer supporting CVS Health’s healthcare operations through scalable compensation-platform integrations. Configuring SPM applications, enterprise integrations, analytics, governance, and production support.
Senior DevOps/Platform Engineer
Senior DevOps Engineer migrating 2,000+ repositories and CI/CD ecosystems for global IT services company Miratech. Automating GitHub, Terraform, AWS/EKS, Kubernetes, and Jenkins platform transformations.
Senior DevOps/Platform Engineer
Senior DevOps Engineer leading enterprise GitHub repository and CI/CD migrations at Miratech, a global IT services company. Automating platform transitions across GitHub Enterprise, Terraform, AWS/EKS, Kubernetes, and Jenkins.
Senior DevOps/Platform Engineer
Senior DevOps Engineer migrating 2,000+ repositories and CI/CD ecosystems for global IT consultancy Miratech. Automating GitHub, Terraform, AWS/EKS, Kubernetes, and Jenkins platform transformations.
Lead Power Platform Solutions Engineer
Lead Power Platform engineer guiding Manulife’s financial services teams in governed Dynamics 365, Copilot Studio, and AI solution design. Training global teams and standardizing enterprise integrations.
Staff Platform Engineer – AI Platform
Staff Platform Engineer building an AI platform for Facility Grid’s construction commissioning and turnover software. Owning AWS production reliability, agent operations, cloud cost, and compliance.