Kong's AI Gateway team is hiring an engineer to work on multi-LLM routing and balancing, semantic caching and routing, MCP, and more.
Responsibilities
- ▹Build and maintain API management software for AI/LLMs and its underlying stack
- ▹Implement new features: proxying, load balancing, database support extensions
- ▹Troubleshoot bugs, tune performance, low-level optimizations
- ▹Fill gaps between Kong and third-party deployment platforms and tooling
- ▹Perform additional tasks as required by manager
Requirements
- ▹3+ years programming server-side applications and components
- ▹Hands-on experience with Golang or Rust
- ▹Experience building and debugging highly scalable, distributed, reliable, resilient applications
- ▹Solid hands-on Linux systems troubleshooting and profiling expertise
- ▹Experience with distributed systems, Linux networking stack, and systems programming (L7 and L4 protocols)
- ▹Comfortable working with a remotely distributed team
- ▹Strong sense of ownership, excellent written/verbal communication (engineers write documentation)
- ▹Familiarity with AI/LLM concepts and application development
Nice to have
- ▹Hands-on experience with NGINX/OpenResty/Kong/LuaJIT
- ▹Hands-on experience with Envoy or Istio
Soft skills
Strong sense of ownershipExcellent written and verbal communicationWorking with a remotely distributed team
About the company
Kong Inc. is a leading developer of API and AI connectivity technologies, building the infrastructure that powers the agentic era.
Similar jobs

Job
Software Engineer-
Cloudflare
Llm
💰 Salary: not specified
🏢 On-site
🗣️ EN

Job
Software Engineer, Network Firewall
Cloudflare
💰 Salary: not specified
🏢 On-site
🗣️ EN

Job
Software Engineering Director
Canonical
Cpp
+7
💰 Salary: not specified
🌍 Remote
🗣️ EN

Job
Software Engineer - Network Platforms
Cloudflare
Cpp
+1
💰 Salary: not specified
🏢 On-site
🗣️ EN

Job
Software Engineer, Network Performance & Reliability
Cloudflare
CppClickhouse
+4
💰 Salary: not specified
🏢 On-site
🗣️ EN

Job
Software Engineer, Compute Infrastructure
Render
Llm
$170,000–$290,000/yr
gross
🌍 Remote
🗣️ EN
