On OpenRouter's Platform team, you will own and scale the systems that route and serve millions of LLM requests every day, from cloud infrastructure to the data layer.
Responsibilities
- ▹Own and evolve edge and cloud infrastructure across Cloudflare, Google Cloud, and Vercel
- ▹Scale and operate the data layer including Spanner, ClickHouse, and Postgres
- ▹Optimize performance for serving LLM inference as traffic rapidly grows
- ▹Partner with engineering leadership on capacity, reliability, and cost, owning systems that carry production traffic
- ▹Set the bar and playbook for how infrastructure and operations are run as the team grows — tooling, observability, on-call, patterns
Requirements
- ▹5+ years building and operating production infrastructure at companies where uptime, latency, and cost matter
- ▹Proven experience with cloud platforms (GCP, AWS, Azure) and edge-first serverless platforms (e.g. Cloudflare Workers)
- ▹Deep expertise operating large-scale databases (e.g. Postgres, Spanner)
- ▹Comfortable across a full-stack TypeScript environment
- ▹High agency and a bias toward action; you fix bottlenecks without waiting for tickets
- ▹AI-forward workflow: heavy use of coding agents, MCPs, and LLMs
- ▹Pragmatic about tradeoffs between speed and simplicity
Nice to have
- ▹Existing user of OpenRouter, or active side projects in AI products/infrastructure or developer tooling
Soft skills
High agencyProactive, sees and fixes bottlenecks without being askedPragmatic decision-making
What we offer
- ▹$215,000 – $285,000 USD base salary (US), plus benefits and equity
- ▹Compensation adjusted to local market conditions for international candidates
About the company
OpenRouter is the leading AI routing and infrastructure layer that enterprises use to access, manage, and optimize the best large language models across providers, without lock-in, capacity constraints, or unnecessary cost.
Ähnliche Stellen

Stelle
Software Engineer, Application Integration
Bayesian Health
AI/MLLlm
+3
💰 Gehalt: keine Angabe
🌍 Remote
🗣️ EN
Stelle
Software Engineer III | AI/ML
ExtraHop
AI/ML
+9
💰 Gehalt: keine Angabe
🌍 Remote
🗣️ EN

Stelle
Software engineer, connectors & MCP
Writer
+5
135 409–264 981 €/Jahr
brutto
🔀 Hybrid
San Francisco
🗣️ EN

Stelle
Software Engineer, Backend
Ema
Clickhouse
+10
117 634–174 272 €/Jahr
brutto
🏢 Vor Ort
San Francisco Bay Area
🗣️ EN

Stelle
Cloud Software Engineer - Observability Platform
ClickHouse
ArgocdClickhouse
+8
💰 Gehalt: keine Angabe
🏢 Vor Ort
🗣️ EN

Stelle
Software Engineer, Data Platform
Profound
AI/MLClickhouseDagster
+6
121 990–226 554 €/Jahr
brutto
🏢 Vor Ort
New York
🗣️ EN
