
Sovereign AI Platform Engineer - T Cloud Public (REF5674Y)
Design, build, and operate a sovereign AI toolchain used in isolated or tightly controlled environments, including model serving, retrieval, orchestration, observability, and secure platform operations for enterprise AI engineering workloads.
Responsibilities
- ▹Design and run Kubernetes environments optimized for AI inference, retrieval, experimentation, and agent execution in secure or isolated settings
- ▹Deploy and operate open-source or open-weight model stacks, model gateways, vector databases, and supporting platform components
- ▹Build reproducible platform automation using Infrastructure as Code and GitOps approaches for stable, auditable delivery
- ▹Manage local registries, package mirrors, secrets, access controls, storage, networking, and observability in environments with limited or no public cloud dependency
- ▹Optimize GPU, compute, and storage usage for reliable AI workloads while maintaining security and data sovereignty requirements
Requirements
- ▹5+ years in platform engineering, DevOps, SRE, or MLOps, with strong Kubernetes and Linux expertise
- ▹Proven experience with AI infrastructure, model serving, private or on-prem deployments, and production operations for LLM-based workloads
- ▹Strong hands-on skills in Python plus automation tooling such as Terraform, Ansible, Helm, and GitOps workflows
- ▹Good understanding of networking, storage, access control, monitoring, and operational hardening in high-security environments
- ▹Comfortable working in sovereignty-driven environments where auditability, isolation, and controlled data handling are mandatory
Nice to have
- ▹Inference and local serving stacks such as vLLM, Ollama, llama.cpp, or OpenAI-compatible self-hosted endpoints
- ▹Open-source or open-weight models appropriate for sovereign deployment
- ▹Platform tooling such as Kubernetes, Helm, Terraform, Ansible, ArgoCD, private registries, Qdrant or similar vector stores, and Open WebUI or comparable internal interfaces
- ▹Developer-facing integration options such as VS Code-compatible extensions, Continue-style local model connectors, or editor integrations pointed at internal APIs
- ▹Hardware awareness covering GPU-backed nodes, CPU-only fallback options, storage performance, network isolation, and on-prem or dedicated infrastructure patterns
About the company
As Hungary's most attractive employer in 2025 (according to Randstad's representative survey), Deutsche Telekom IT Solutions is a subsidiary of the Deutsche Telekom Group. The company provides a wide portfolio of IT and telecommunications services with more than 5,300 employees, serving hundreds of large customers in Germany and other European countries. DT-ITS received the Best in Educational Cooperation award from HIPA in 2019 and was acknowledged as the Most Ethical Multinational Company in 2019. The company continuously develops its four sites in Budapest, Debrecen, Pécs, and Szeged.
Similar jobs

Industrial AI Cloud - Platform Engineer (REF5501C)
AI Platform Engineer
AI Platform Engineer
Sovereign AI Platform Engineer T Cloud Public (m/f/d)
