Tokens-as-a-Service (TaaS) Software Engineer

Responsibilities

• ▹Develop systems and tooling to measure, monitor, and improve token throughput across first-party and partner-owned compute environments
• ▹Support performance benchmarking, tokenomics analysis, and model porting across heterogeneous infrastructure environments
• ▹Build tooling to integrate external or partner infrastructure into OpenAI's internal compute, observability, and workload management systems
• ▹Develop and monitor operational metrics including billing, usage, SLAs, utilization, reliability, and throughput
• ▹Identify bottlenecks across hardware, networking, software, and workload enablement
• ▹Partner with compute, infrastructure, networking, finance, and operations teams to translate raw capacity into usable capacity
• ▹Build dashboards, automation, and reporting systems for TaaS capacity, performance, and business outcomes

Requirements

• ▹Strong software engineering background building systems, tooling, automation, or infrastructure platforms
• ▹Experience with compute infrastructure, distributed systems, performance engineering, or production operations
• ▹Ability to reason about token throughput, utilization, benchmarking, and infrastructure efficiency
• ▹Comfortable integrating external systems or partner environments into internal infrastructure stacks
• ▹Strong analytical and debugging skills across hardware, networking, software, and operational domains

Nice to have

• ▹Experience with GPU clusters, AI infrastructure, performance benchmarking, or workload optimization
• ▹Familiarity with model porting, inference/training workloads, token economics, or compute efficiency analysis
• ▹Experience building monitoring systems for billing, usage, SLAs, utilization, or infrastructure reliability
• ▹Background in systems engineering, infrastructure software, observability, distributed systems, or platform engineering

About the company

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. As an equal-opportunity employer, it pushes the boundaries of AI capabilities while keeping safety and human needs at the core of its work, and values the diverse perspectives and experiences that reflect the full spectrum of humanity.