Software Engineer- GPU Fabric Observability

Stack

Responsibilities

• ▹Own Baseten's GPU fabric observability and root-cause analysis architecture
• ▹Build telemetry pipelines across switches, NICs, hosts, GPUs, Kubernetes, and inference services
• ▹Model topology, flow paths, service ownership, and failure domains
• ▹Separate true fabric faults from host, NIC, GPU, kernel, driver, RDMA, scheduler, and workload failures
• ▹Create clear operator workflows for triage, remediation, and post-incident learning

Requirements

• ▹Staff-level or senior staff-level experience building production infrastructure software
• ▹Strong distributed systems background, especially streaming systems, telemetry pipelines, diagnostics, or control-plane software
• ▹Experience building systems that process high-volume, high-cardinality, noisy operational data
• ▹Understanding of networking fundamentals and high-performance networks
• ▹Ability to work with low-level infrastructure signals and build practical correlation, anomaly detection, or root-cause analysis systems

Soft skills

What we offer

• ▹Competitive compensation, including meaningful equity
• ▹100% coverage of medical, dental, and vision insurance for employee and dependents
• ▹Flexible PTO policy, including a company-wide Winter Break (offices closed from Christmas Eve to New Year's Day)
• ▹Paid parental leave
• ▹Fertility and family-building stipend through Carrot
• ▹Company-facilitated 401(k)
• ▹Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities

About the company

Baseten powers mission-critical inference for some of the world's most dynamic AI companies, including Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, Baseten helps companies operating at the frontier of AI bring cutting-edge models into production. The company is growing quickly and recently closed a $1.5B Series F round led by Altimeter Capital, Conviction Partners, and Spark Capital.