Machine Learning Engineer, Ops

Stack

Responsibilities

• ▹Design and maintain inference infrastructure for generative audio model architectures
• ▹Implement and manage high-performance inference engines
• ▹Orchestrate service deployments using Kubernetes with advanced autoscaling to handle varying traffic loads efficiently
• ▹Develop and automate CI/CD pipelines for testing and deploying model artifacts and inference configurations
• ▹Monitor production systems, establishing observability practices to track latency, resource utilization and model performance
• ▹Collaborate closely with research teams to optimize model serving paths and evaluate inference strategies
• ▹Optimize inference performance for both streaming and batch applications

Requirements

• ▹Deep understanding of modern audio model architectures (e.g., TTS, ASR) and their inference requirements
• ▹Strong hands-on experience with Kubernetes, container orchestration and autoscaling strategies for production workloads
• ▹Solid MLOps background, including CI/CD automation and managing scalable cloud infrastructure
• ▹Proficiency in software engineering principles and experience with Python or Go for infrastructure tooling and backend services
• ▹Experience with GPU-accelerated inference and performance profiling techniques

Nice to have

• ▹Familiarity with high-performance inference engines (e.g., Triton Inference Server, vLLM-Omni)

Soft skills

What we offer

• ▹Competitive salary and generous company equity (U.S.-based roles)
• ▹Medical, dental and vision insurance with 99.99% of premiums covered (U.S.-based roles)
• ▹42 days of paid time off: 15 PTO days, 10 sick days, 15 company holidays, 2 floating holidays (U.S.-based roles)
• ▹Parental leave and fertility support (U.S.-based roles)
• ▹401(k) retirement savings plan (U.S.-based roles)
• ▹Lifestyle spending account of $500/month (U.S.-based roles)
• ▹Complimentary lunch and snacks for in-office employees
• ▹One Medical membership (U.S.-based roles)

About the company

Cantina Labs is a social AI company developing advanced real-time models that push the boundaries of expression, personality and realism; its flagship product is the Cantina social AI platform.