Site Reliability Engineer (SRE)

Stack

Responsibilities

• ▹Own the reliability of Baseten's multi-cloud Kubernetes infrastructure, including incident response, post-mortems, and remediation tracking
• ▹Build and maintain observability infrastructure — metrics, logging, dashboards, and alerting — as code
• ▹Author and improve runbooks for recurring failure patterns, structured for low-context, safe execution
• ▹Identify high-frequency failure patterns and convert them into automated or self-healing mitigations
• ▹Diagnose and resolve runtime issues related to latency, memory behavior, GPU utilization, concurrency, and model lifecycle management
• ▹Define and instrument SLOs and SLIs across customer workloads and internal services

Requirements

• ▹Extensive hands-on experience with Kubernetes (multi-cloud experience across EKS, GKE, or similar is a strong plus)
• ▹Experience building and maintaining scalable infrastructure
• ▹Strong foundation in observability tooling: metrics (VictoriaMetrics, Prometheus), logging (Loki, ELK), dashboards (Grafana), alerting pipelines
• ▹Experience with infrastructure-as-code (Terraform, Helm) and GitOps workflows (Flux CD, ArgoCD)
• ▹Experience writing and improving runbooks, leading incident response, and doing post-mortem analysis

Nice to have

• ▹Observability-as-code experience
• ▹Familiarity with incident management platforms (incident.io or similar)
• ▹Curiosity about how ML models are deployed and served at scale

Soft skills

What we offer

• ▹Competitive compensation including meaningful equity
• ▹100% coverage of medical, dental and vision insurance for employee and dependents
• ▹Flexible PTO including a company-wide winter break (closed between Christmas Eve and New Year's Day)
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)
• ▹Exposure to a variety of ML startups, offering great learning and networking opportunities

About the company

Baseten powers mission-critical inference for some of the world's most dynamic AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By combining applied AI research, flexible infrastructure and seamless developer tooling, they help companies bring cutting-edge models into production. The company is growing fast and recently closed a $1.5B Series F round led by Altimeter Capital, Conviction Partners and Spark Capital.