Software Engineer AI Gateway
Pubblicato il 17-10-2026 - Kong in Milano
Overview In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.
Responsabilità
Build and maintain API management software for AI/LLMs and its underlying stack Implement features like proxying, load balancing, and databases support for Kong AI Gateway Troubleshoot bugs, tune performance,
and perform low-level optimizations Bridge Kong with third-party deployment platforms and tooling Handle additional tasks as directed by management
Requisiti fondamentali
3+ years of server-side application and component development Hands-on experience with Golang or Rust Experience building and debugging highly scalable, distributed, reliable systems Strong Linux systems troubleshooting and profiling skills Knowledge of distributed systems and Linux networking; API exposure on L7/L4 Comfortable working with a remotely distributed team Strong ownership and communication skills; experience documenting products Familiarity with AI/LLM concepts and applications development strong communication ownership collaboration Golang or Rust Linux troubleshooting and profiling distributed systems
