DevOps Engineer (AI Inference)

Stack

Responsibilities

• ▹Design and maintain infrastructure for AI inference workloads
• ▹Set up GPU scheduling and model deployment pipelines
• ▹Build monitoring and observability tools (dashboards, alerts, runbooks)
• ▹Collaborate with ML engineers on system architecture

Requirements

• ▹Experience with Kubernetes architecture and operating production clusters
• ▹Strong Linux and networking troubleshooting skills
• ▹Automation experience with Python, Go or Bash
• ▹Experience with Terraform, Ansible or similar IaC tools
• ▹Experience with Git-based workflows and CI/CD

Nice to have

• ▹Familiarity with Cluster API or similar Kubernetes lifecycle tools
• ▹Hands-on experience with Slurm clusters
• ▹Knowledge of Argo CD, GitOps and Helm
• ▹Exposure to GPU or HPC environments

Soft skills

About the company

Gcore is a global provider of AI, cloud, network and security infrastructure, with 210+ edge locations and 50+ cloud regions, partnering with companies like NVIDIA and Dell.