Software Engineer, AI Gateway
h3About the Role: /h3 pYou will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI LLM based innovation. /p pAs a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more. /p h3What You'll Do: /h3 ul lipResponsible for building and maintaining API management software for AI and LLMs and its underlying stack. /p /li lipImplement new innovative features including proxying capabilities, load balancing, databases support that extend Kong AI Gateway’s offering. /p /li lipBugs troubleshooting, performance tuning and low-level optimizations. /p /li lipFill the gaps between Kong and third-party deployment platforms and tooling. /p /li lipAny additional tasks required by manager. /p /li /ul h3What You'll Bring: /h3 ul lip3+ years of programming in server-side applications and components. /p /li lipHands on experience with either Golang or Rust /p /li lipExperience building and debugging applications that are highly scalable, distributed, reliable and resilient.
/p /li lipSolid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling. /p /li lipExperience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required. /p /li lipComfortable working with a remotely distributed team. /p /li lipStrong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products /p /li lipFamiliarity with AI LLM concepts and applications development /p /li /ul h3Bonus Points: /h3 ul lipHands on experience with NGINX/OpenResty/Kong/LuaJIT. /p /li lipHands on experience with Envoy or Istio. /p /li /ul p#LI-EA1 /p h3About Kong: /h3 pKong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit /p #J-18808-Ljbffr
/p /li lipSolid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling. /p /li lipExperience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols, so this expertise and knowledge are required. /p /li lipComfortable working with a remotely distributed team. /p /li lipStrong sense of ownership and excellent verbal and written communication skills -- engineers at Kong write the documentation for their products /p /li lipFamiliarity with AI LLM concepts and applications development /p /li /ul h3Bonus Points: /h3 ul lipHands on experience with NGINX/OpenResty/Kong/LuaJIT. /p /li lipHands on experience with Envoy or Istio. /p /li /ul p#LI-EA1 /p h3About Kong: /h3 pKong Inc., the AI Connectivity Company, is building the connectivity layer of AI. Trusted by the Fortune 500® and AI-native startups alike, Kong’s unified API and AI platform enables organizations to secure, manage, accelerate, govern, and monetize the flow of intelligence across APIs and AI traffic — on any model, any cloud. For more information, visit /p #J-18808-Ljbffr