Software Engineer AI Gateway
Pubblicato il 19-10-2026 - Kong in Milano
Overview
In this role you join the AI Gateway Engineering Team to build and evolve the Kong AI gateway. You will tackle multi-LLM routing, semantic routing, and performance-focused features that power AI-enabled workflows. You will contribute to a scalable API management stack, bridging Kong with third-party deployment platforms, and drive reliability at scale. This role offers hands-on development, optimization, and cross-functional collaboration in a mission-driven, innovative environment. You will help shape how organizations govern AI and LLM-based innovation.
Responsabilità
- Build and maintain API management software for AI/LLMs and its underlying stack
- Implement features like proxying, load balancing, and databases support for Kong AI Gateway
- Troubleshoot bugs, tune performance, and perform low-level optimizations
- Bridge Kong with third-party deployment platforms and tooling
- Handle additional tasks as directed by management
Requisiti fondamentali
- 3+ years of server-side application and component development
- Hands-on experience with Golang or Rust
- Experience building and debugging highly scalable, distributed, reliable systems
- Strong Linux systems troubleshooting and profiling skills
- Knowledge of distributed systems and Linux networking; API exposure on L7/L4
- Comfortable working with a remotely distributed team
- Strong ownership and communication skills; experience documenting products
- Familiarity with AI/LLM concepts and applications development
- strong communication
- ownership
- collaboration
- Golang or Rust
- Linux troubleshooting and profiling
- distributed systems