← Back to list
Job

Software Engineer, Platform

Software Engineer • Remote • Full-time United States USA

On OpenRouter's Platform team, you will own and scale the systems that route and serve millions of LLM requests every day, from cloud infrastructure to the data layer.

Responsibilities

  • Own and evolve edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel
  • Scale and operate the data layer including Spanner, ClickHouse, and Postgres
  • Optimize performance for serving LLM inference as traffic rapidly grows
  • Partner with engineering leadership on capacity, reliability, and cost, owning systems that carry production traffic
  • Set the bar and playbook for how infrastructure and operations are run as the team grows — tooling, observability, on-call, patterns

Requirements

  • 5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter
  • Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers)
  • Deep expertise operating large-scale databases (e.g. Postgres, Spanner)
  • Comfortable across a full-stack TypeScript environment
  • High agency and a bias toward action; you fix bottlenecks without waiting for tickets
  • AI-forward workflow: heavy use of coding agents, MCPs, and LLMs
  • Pragmatic about tradeoffs between speed and simplicity

Nice to have

  • Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling

Soft skills

High agencyProactive, sees and fixes bottlenecks without being askedPragmatic decision-making

What we offer

  • $215,000 – $285,000 USD base salary (US), plus benefits and equity
  • Compensation adjusted to local market conditions for international candidates

About the company

OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers, without lock-in, capacity constraints, or unnecessary cost.

Similar jobs