Software Engineer – AI Gateway

Stack

Responsibilities

• ▹Build and maintain API management software for AI/LLMs and its underlying stack
• ▹Implement new features such as proxying, load balancing and database support
• ▹Troubleshoot bugs, tune performance and handle low-level optimizations
• ▹Bridge gaps with third-party deployment platforms and tooling
• ▹Take on additional tasks as required by the manager

Requirements

• ▹3+ years of server-side programming experience
• ▹Hands-on experience with Golang or Rust
• ▹Experience building scalable, distributed, reliable and resilient applications
• ▹Linux systems troubleshooting and profiling
• ▹Distributed systems, Linux networking stack and systems programming (L7/L4 protocols)
• ▹Comfortable working with a remotely distributed team
• ▹Strong sense of ownership and excellent verbal/written communication
• ▹Familiarity with AI/LLM concepts and application development

Nice to have

• ▹Hands-on experience with NGINX/OpenResty/Kong/LuaJIT
• ▹Hands-on experience with Envoy or Istio

Soft skills

About the company

Kong Inc. is a leading developer of API and AI connectivity technologies, building the infrastructure that powers the agentic era. Trusted by Fortune 500 companies and startups alike, its Kong Konnect platform secures, manages, accelerates and monetizes the flow of intelligence across APIs and AI models.