SRE

Stack

Responsibilities

• ▹Own the reliability of Baseten's multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking
• ▹Build and maintain observability infrastructure — metrics, logging, dashboards, and alerting — as code
• ▹Author, validate, and improve runbooks for recurring failure patterns
• ▹Identify high-frequency failure patterns and convert them into automated mitigations or self-healing automations
• ▹Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management
• ▹Define and instrument SLOs and SLIs across customer workloads and internal services

Requirements

• ▹Extensive hands-on experience with Kubernetes (multi-cloud across EKS, GKE, or similar is a strong plus)
• ▹Experience building and maintaining scalable infrastructure
• ▹Strong foundation in observability tooling: metrics (VictoriaMetrics, Prometheus), logging (Loki, ELK), dashboards (Grafana), and alerting pipelines
• ▹Experience with infrastructure-as-code (Terraform, Helm) and GitOps workflows (Flux CD, ArgoCD)
• ▹Experience writing and improving runbooks, leading incident response, and post-mortem analysis

Nice to have

• ▹Observability-as-code experience
• ▹Familiarity with incident management platforms (e.g. incident.io)
• ▹No prior ML experience required, but curiosity about ML model deployment is a plus

Soft skills

What we offer

• ▹Competitive compensation, including meaningful equity
• ▹100% coverage of medical, dental, and vision insurance for employee and dependents
• ▹Flexible PTO policy including company-wide Winter Break
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)

About the company

Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. The company recently raised a $1.5B Series F.