Software Engineer, Agent Infrastructure

Stack

Responsibilities

• ▹Contribute as a core engineer to an in-house container orchestration platform built to scale far beyond systems like Kubernetes
• ▹Develop and maintain FastAPI and gRPC APIs that serve as the interface for the agent infrastructure used in both training and production
• ▹Use Terraform to build and evolve complex infrastructure for research and production
• ▹Collaborate with research teams to stand up and optimize systems for novel AI training runs and experimental applications

Requirements

• ▹Deep experience with large-scale machine learning infrastructure
• ▹Ability to reason about training at scale, identify bottlenecks, and engineer solutions to optimize performance
• ▹Track record of building new systems from 0 to 1 and scaling them massively
• ▹Strong eye for performance and optimization in complex, globally distributed systems
• ▹Familiarity with cloud platforms and infrastructure-as-code tools such as Terraform

Nice to have

• ▹Deep technical expertise in virtualization and containerization technologies (e.g. Kata, Firecracker, gVisor, Sysbox)

Soft skills

What we offer

• ▹Relocation assistance
• ▹Hybrid work model, 3 days per week in the office

About the company

OpenAI is an AI research and deployment company whose mission is to ensure that general-purpose artificial intelligence benefits all of humanity. The company continually pushes the boundaries of AI capabilities and works to safely deploy them to the world through its products, while placing safety and human needs at the core of its work and striving to reflect the full spectrum of human perspectives and experience.