AI Solution Architect

Stack

Responsibilities

• ▹Designing and evolving the overall AI/ML architecture on Azure as an enterprise AI platform
• ▹Providing technical leadership for ML pipeline projects, including training, deployment, monitoring and drift detection
• ▹Designing and optimizing RAG architectures, e.g. chunking, retrieval, guardrails and context orchestration
• ▹Defining MLOps strategies, including CI/CD for models, experiment tracking and model registry
• ▹Leading and coordinating an interdisciplinary team of ML/AI engineers, LLM engineers and MLOps engineers
• ▹Advising on AI governance, responsible AI and EU AI Act compliance, and presenting architecture to IT leadership and business stakeholders

Requirements

• ▹Solid experience with Azure-based AI/ML solutions, especially Azure Machine Learning and Azure OpenAI Service
• ▹Hands-on experience with MLOps concepts and tools (e.g. MLflow, Kubeflow, Azure ML Pipelines)
• ▹Experience building RAG architectures, prompt engineering, working with vector databases, and integrating language models via APIs
• ▹Experience with CI/CD for ML applications and solid Python skills
• ▹Practical experience with at least two common ML frameworks (e.g. scikit-learn, PyTorch, TensorFlow)
• ▹Experience building enterprise architectures in cloud environments
• ▹Understanding of governance, security and compliance requirements in regulated environments
• ▹Several years of experience with ML/AI architectures or comparable technical roles in enterprise environments

Nice to have

• ▹Knowledge of further Azure AI services
• ▹Experience with orchestration frameworks such as LangChain or LlamaIndex
• ▹Knowledge of data platforms, containerization, container orchestration, infrastructure as code and observability (e.g. Databricks, Azure Data Factory, Azure Data Lake, Docker, Kubernetes, Terraform, Prometheus, Grafana, Application Insights)
• ▹Knowledge of relevant standards and regulations (ISO 27001, NIS2, BSI requirements, EU AI Act)
• ▹Experience in a technical leadership or architecture role, relevant Azure certifications
• ▹Experience in the energy or utilities sector, with predictive maintenance, time-series analysis or public procurement procedures (VgV, EVB-IT)

Soft skills

What we offer

• ▹Flexible working hours and remote work
• ▹Individual hardware budget
• ▹Free access to professional psychological support (OpenUp)
• ▹Individual training budget
• ▹Employee PC leasing program for private use
• ▹JobRad bike leasing or company car

About the company

The company is a German IT service provider driving the digitalization of the public sector, in this case within its Environment, Transportation & Energy customer cluster. It promotes a transparent, goal-oriented culture it calls 'Responsiveness', giving employees a real say in shaping change.