On OpenRouter's Platform team, you will own and scale the systems that route and serve millions of LLM requests every day, from cloud infrastructure to the data layer.
Responsibilities
- ▹Own and evolve edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel
- ▹Scale and operate the data layer including Spanner, ClickHouse, and Postgres
- ▹Optimize performance for serving LLM inference as traffic rapidly grows
- ▹Partner with engineering leadership on capacity, reliability, and cost, owning systems that carry production traffic
- ▹Set the bar and playbook for how infrastructure and operations are run as the team grows — tooling, observability, on-call, patterns
Requirements
- ▹5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter
- ▹Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers)
- ▹Deep expertise operating large-scale databases (e.g. Postgres, Spanner)
- ▹Comfortable across a full-stack TypeScript environment
- ▹High agency and a bias toward action; you fix bottlenecks without waiting for tickets
- ▹AI-forward workflow: heavy use of coding agents, MCPs, and LLMs
- ▹Pragmatic about tradeoffs between speed and simplicity
Nice to have
- ▹Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling
Soft skills
High agencyProactive, sees and fixes bottlenecks without being askedPragmatic decision-making
What we offer
- ▹$215,000 – $285,000 USD base salary (US), plus benefits and equity
- ▹Compensation adjusted to local market conditions for international candidates
About the company
OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers, without lock-in, capacity constraints, or unnecessary cost.
Similar jobs

Job
Software Engineer, Application Integration
Bayesian Health
AI/MLLlm
+3
💰 Salary: not specified
🌍 Remote
🗣️ EN
Job
Software Engineer III | AI/ML
ExtraHop
AI/ML
+9
💰 Salary: not specified
🌍 Remote
🗣️ EN

Job
Software engineer, connectors & MCP
Writer
+5
$155,400–$304,100/yr
gross
🔀 Hybrid
San Francisco
🗣️ EN

Job
Software Engineer, Backend
Ema
Clickhouse
+10
$135,000–$200,000/yr
gross
🏢 On-site
San Francisco Bay Area
🗣️ EN

Job
Cloud Software Engineer - Observability Platform
ClickHouse
ArgocdClickhouse
+8
💰 Salary: not specified
🏢 On-site
🗣️ EN

Job
Software Engineer, Data Platform
Profound
AI/MLClickhouseDagster
+6
$140,000–$260,000/yr
gross
🏢 On-site
New York
🗣️ EN
