Senior AI DevOps / LLMOps

Stack

Responsibilities

• ▹Design CI/CD pipelines for AI models, data versioning
• ▹Develop PromptOps workflows (versioned, tested prompts)
• ▹Automate deployment of agentic workflows
• ▹Manage GPU/TPU compute environments with IaC tools
• ▹Enforce Policy-as-Code on AI endpoints
• ▹Build canary, blue-green, and shadow release strategies
• ▹Build evaluation gates for bias/hallucination detection
• ▹Establish observability for inference endpoints

Requirements

• ▹Advanced Kubernetes skills (KubeFlow, Ray, NVIDIA Triton)
• ▹Expertise in GitHub Actions/GitLab CI and Terraform or Pulumi
• ▹Experience with Weights & Biases, MLflow, LangSmith
• ▹GPU virtualization, CUDA driver knowledge
• ▹Familiarity with Open Policy Agent and secrets management (Vault)
• ▹10+ years in DevOps, SRE, or Cloud Engineering
• ▹2+ years hands-on MLOps/LLMOps experience
• ▹Experience managing hybrid cloud environments

Soft skills

What we offer

• ▹Fully remote work

About the company

TechBiz Global provides recruitment services to its clients; this role is on behalf of a client company.