Director of Software Engineering - Product & Platform Delivery

Stack

Responsibilities

• ▹Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage
• ▹Establish rigorous SRE practices: SLA/SLO definitions, incident response, observability, and automated remediation
• ▹Oversee the design, scaling, and operation of Runpod's global network backbone and ultra-low-latency HPC cluster networks
• ▹Drive the implementation and optimization of InfiniBand and RoCE for massive, multi-node GPU training workloads
• ▹Direct the architecture and performance tuning of highly scalable, distributed storage systems
• ▹Hire, mentor, and grow highly technical engineering managers and senior ICs
• ▹Partner with Program Management and Product to forecast capacity requirements and shape technical roadmaps
• ▹Drive measurable improvements in reliability and delivery metrics: deployment frequency, MTTR, IaC coverage, uptime
• ▹Provide architectural oversight for bare-metal provisioning, virtualization layers, network fabrics, and storage clusters
• ▹Coordinate with product delivery and platform teams to keep infrastructure primitives robust and highly available

Requirements

• ▹7+ years leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads
• ▹8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms
• ▹Hands-on background or strong architectural understanding of ultra-low latency networking: InfiniBand and/or RoCE, spine-leaf architectures, global WAN routing (BGP)
• ▹Experience building, operating, or tuning high-performance distributed storage systems and parallel file systems (e.g., Ceph, Lustre, Weka, NVMe-oF)
• ▹Strong foundation in SRE/DevOps culture: infrastructure-as-code (Terraform, Ansible), container orchestration (Kubernetes), modern observability
• ▹Experience building culture, accountability, and momentum across distributed technical teams
• ▹Clear written and verbal communication, strong stakeholder management, calm decisive leadership during incidents
• ▹Successful completion of a background check

Nice to have

• ▹Direct experience architecting infrastructure optimized for massive GPU clusters and AI/ML workloads
• ▹Deep understanding of hardware architectures, GPU interconnects (NVLink), and datacenter topology
• ▹Track record of scaling infrastructure teams in hyper-growth startup environments
• ▹Open-source contributions or recognition within the infrastructure, networking, or Kubernetes communities

Soft skills

What we offer

• ▹Competitive base pay of $225,000-$325,000
• ▹Meaningful equity in a fast-growing company
• ▹Generous medical, dental & vision plans
• ▹Flexible PTO
• ▹Remote-first role with Slack as the main communication channel
• ▹$1,200 Home Office & Equipment Stipend

About the company

Runpod is the AI Developer Cloud: more than one million developers use it from research to production, and the platform has processed more than 20 billion inference requests; Runpod closed a $100M Series A in June 2026.