Software Engineer, Workload Enablement

Stack

Responsibilities

• ▹Port and validate key inference and training workloads on new platforms/SKUs, driving correctness, performance, and stability to an internal readiness bar
• ▹Build a suite of benchmarks and stress tests capturing real end-to-end behavior (CPU, GPU, memory subsystem, WAN, NVLink and RDMA collectives, storage, thermals)
• ▹Deep-dive performance on distributed training/inference: collective performance and tuning (NCCL/RCCL), compute/communication overlap, kernel-level bottlenecks
• ▹Create repeatable test harnesses for CI/lab environments that produce actionable outputs (pass/fail, performance score, regression detection)
• ▹Partner with systems and fleet bring-up engineers so the platform is stable, performant, and operationally usable
• ▹Work with vendors and internal stakeholders, producing clear bug reports and prioritized issue lists

Requirements

• ▹BS in CS/EE (or equivalent practical experience)
• ▹5+ years in ML systems, performance engineering, distributed systems, or HPC
• ▹Strong, hands-on experience with PyTorch and modern LLM training/inference stacks
• ▹Understanding of large-scale distributed training concepts (data/model/pipeline parallel, collective comms)
• ▹Experience with RDMA and debugging/optimizing comms libraries (NCCL or RCCL)
• ▹Proficiency in Python plus comfort reading/writing performance-critical code (C++/CUDA/HIP a plus)
• ▹Strong profiling/debugging skills (Nsight, rocprof, perf, flamegraphs)

Nice to have

• ▹Experience building workload-shaped benchmarks and stress/fault tests correlating to production behavior
• ▹Familiarity with RDMA networking and transport tuning
• ▹Experience running and validating workloads in Kubernetes
• ▹Hands-on lab experience with early hardware (new NICs, GPUs/accelerators, early racks)

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. The company is an equal opportunity employer and does not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other legally protected characteristics.