Lead AI Application Engineer (Infrastructure & LLMOps)

Stack

Responsibilities

• ▹Architect and maintain a multi-tenant AI platform
• ▹Implement LLMOps/MLOps automated deployment pipelines
• ▹Build Inference-, Embeddings- and RAG-as-a-Service capabilities
• ▹Own vector databases and feature stores
• ▹Build a self-service portal/CLI for product squads

Requirements

• ▹Deep experience with Kubernetes, Docker, Terraform/Pulumi
• ▹Hybrid cloud experience (AWS/Azure/GCP and on-premises)
• ▹Experience with vLLM, TGI or NVIDIA Triton
• ▹Expertise in vector DBs and SQL/NoSQL databases
• ▹High proficiency in Python and Go/Rust
• ▹8+ years in Platform Engineering, DevOps or SRE
• ▹2+ years building AI/ML infrastructure

Nice to have

• ▹Experience building Internal Developer Platforms (IDP)

About the company

TechBiz Global is a recruitment agency sourcing talent for its top-tier clients.