Software Engineer, GPU Infrastructure- ChatGPT Engineering

Stack

Responsibilities

• ▹Design, build, and operate software that manages large-scale GPU infrastructure supporting ChatGPT inference
• ▹Build internal platforms, tooling, and AI-powered agents that automate fleet operations
• ▹Improve observability, reliability, and operational efficiency across thousands of GPUs
• ▹Develop systems for capacity planning, scheduling, fleet health monitoring, and incident response
• ▹Identify infrastructure bottlenecks and implement solutions that improve utilization and scalability
• ▹Partner closely with research, platform, networking, and systems teams
• ▹Help establish engineering best practices around operational excellence, automation, and reliability

Requirements

• ▹5+ years of software engineering experience building production infrastructure
• ▹Strong programming skills in Go, Python, C++, Rust, or similar systems languages
• ▹Experience designing and operating highly available distributed systems
• ▹Experience with GPU infrastructure, high-performance computing, ML infrastructure, or large-scale compute platforms
• ▹Experience with Kubernetes, cloud infrastructure, Linux, networking, and observability tooling
• ▹Excellent debugging, systems design, and operational problem-solving skills
• ▹Strong communication skills collaborating across engineering organizations

Nice to have

• ▹Background in Production Engineering, SRE, Infrastructure Engineering, or Platform Engineering
• ▹Experience building software that automates operational workflows rather than relying on manual processes
• ▹Enjoyment identifying cross-team pain points and building reusable platforms

Soft skills

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity; its ChatGPT Engineering team builds and operates the compute platform behind one of the world's largest AI products.