Operations Manager – AI Services

Stack

Responsibilities

• ▹Assess incoming AI use cases and help teams select the right LLM model
• ▹Balance technical quality, security, compliance, availability, and cost
• ▹Manage the LLM catalog: service requests, approvals, access, credentials, quotas, and onboarding
• ▹Establish monitoring, logging, security, and governance operational controls
• ▹Develop transparent consumption and cost models, and prepare automation of provisioning and reporting
• ▹Provide a fast, practical path to approved LLM access for employees
• ▹Help turn manual workflows into standardized, automated services

Requirements

• ▹Several years of experience in platform or cloud operations, software engineering, technical product management, or IT service management
• ▹Practical knowledge of LLMs, APIs, authentication, observability, and production service operations
• ▹Ability to evaluate technical solutions on quality, security, compliance, reliability, and cost
• ▹Strong stakeholder communication skills
• ▹German at least B2 level
• ▹English at C1 level

Nice to have

• ▹Experience with LLMOps platforms, AI gateways, model evaluation, or AI observability
• ▹FinOps, provider management, or usage-based cloud experience

Soft skills

About the company

Deutsche Telekom IT Solutions is a subsidiary of Deutsche Telekom Group with more than 5,300 employees, offering a wide range of IT and telecommunications services from Budapest, Debrecen, Pécs, and Szeged.