Software Engineer AI Gateway

Stack

Responsibilities

• ▹Build and maintain API management software for AI/LLMs and its underlying stack
• ▹Implement new features: proxying, load balancing, database support extensions
• ▹Troubleshoot bugs, tune performance, low-level optimizations
• ▹Fill gaps between Kong and third-party deployment platforms and tooling
• ▹Perform additional tasks as required by manager

Requirements

• ▹3+ years programming server-side applications and components
• ▹Hands-on experience with Golang or Rust
• ▹Experience building and debugging highly scalable, distributed, reliable, resilient applications
• ▹Solid hands-on Linux systems troubleshooting and profiling expertise
• ▹Experience with distributed systems, Linux networking stack, and systems programming (L7 and L4 protocols)
• ▹Comfortable working with a remotely distributed team
• ▹Strong sense of ownership, excellent written/verbal communication (engineers write documentation)
• ▹Familiarity with AI/LLM concepts and application development

Nice to have

• ▹Hands-on experience with NGINX/OpenResty/Kong/LuaJIT
• ▹Hands-on experience with Envoy or Istio

Soft skills

About the company

Kong Inc. is a leading developer of API and AI connectivity technologies, building the infrastructure that powers the agentic era.