On OpenRouter's Platform team, you will own and scale the systems that route and serve millions of LLM requests every day, from cloud infrastructure to the data layer.
Responsibilities
- ▹Own and evolve edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel
- ▹Scale and operate the data layer including Spanner, ClickHouse, and Postgres
- ▹Optimize performance for serving LLM inference as traffic rapidly grows
- ▹Partner with engineering leadership on capacity, reliability, and cost, owning systems that carry production traffic
- ▹Set the bar and playbook for how infrastructure and operations are run as the team grows — tooling, observability, on-call, patterns
Requirements
- ▹5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter
- ▹Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers)
- ▹Deep expertise operating large-scale databases (e.g. Postgres, Spanner)
- ▹Comfortable across a full-stack TypeScript environment
- ▹High agency and a bias toward action; you fix bottlenecks without waiting for tickets
- ▹AI-forward workflow: heavy use of coding agents, MCPs, and LLMs
- ▹Pragmatic about tradeoffs between speed and simplicity
Nice to have
- ▹Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling
Soft skills
High agencyProactive, sees and fixes bottlenecks without being askedPragmatic decision-making
What we offer
- ▹$215,000 – $285,000 USD base salary (US), plus benefits and equity
- ▹Compensation adjusted to local market conditions for international candidates
About the company
OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers, without lock-in, capacity constraints, or unnecessary cost.
Similar jobs

Job
Backend Software Engineer - Enterprise
E2b
ArgocdGrpc
+6
💰 Salary: not specified
🏢 On-site
San Francisco
🗣️ EN

Job
Software Engineer, Core Platforms
Bot Auto
+17
💰 Salary: not specified
🏢 On-site
Houston
🗣️ EN

Job
Software Engineer, Agentic AI Systems
Rescale
+4
$115,000–$159,000/yr
gross
🌍 Remote
USA only
🗣️ EN

Job
Software Engineer II, General
INSTALILY.AI
Llm
+2
$120,000/yr
gross
🏢 On-site
New York
🗣️ EN

Job
Software Engineer I, General
INSTALILY.AI
Llm
+2
$100,000/yr
gross
🏢 On-site
New York
🗣️ EN

Job
Software Engineer, Full Stack
INSTALILY.AI
AI/ML
+8
$150,000/yr
gross
🏢 On-site
New York
🗣️ EN
