Software Engineer, AI Gateway

Stack

Responsibilities

• ▹Build and maintain API management software for AI/LLMs
• ▹Implement proxying, load balancing, database support features
• ▹Troubleshoot bugs, tune performance, low-level optimization
• ▹Bridge gaps with third-party deployment platforms and tooling

Requirements

• ▹3+ years server-side programming experience
• ▹Hands-on Golang or Rust experience
• ▹Experience with scalable, distributed, resilient systems
• ▹Solid Linux systems troubleshooting and profiling
• ▹Distributed systems, Linux networking, L7/L4 protocols knowledge
• ▹Familiarity with AI/LLM concepts

Nice to have

• ▹Hands-on NGINX/OpenResty/Kong/LuaJIT experience
• ▹Hands-on Envoy or Istio experience

Soft skills

About the company

Kong builds API and AI connectivity infrastructure (Kong Konnect), trusted by Fortune 500 companies to secure, manage and govern API and AI traffic.