Software Engineer 2, AI Gateway
Pubblicato il 26-10-2026 - Kong in Trentino-Alto Adige
Overview
Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach.
Retribuzione / Benefits
- Equity
- Premio
- Health, dental, and vision insurance
- Paid holidays and PTO
- Professional development opportunities
Responsabilità
- Build and maintain API management software for AI/LLM stacks
- Develop features such as proxying, load balancing, and database support for Kong AI Gateway
- Troubleshoot bugs, tune performance,
and perform low-level optimizations
- Bridge Kong with third-party deployment platforms and tooling
- Handle additional tasks as assigned by management
Requisiti fondamentali
- 3+ years of server-side programming
- Hands-on experience with Golang or Rust
- Proven ability to build and debug highly scalable, distributed, reliable systems
- Strong Linux systems troubleshooting and profiling skills
- Experience with distributed systems and Linux networking on L7/L4
- Comfortable working in a globally distributed team
- Strong ownership and communication skills (documentation written by engineers)
- Familiarity with AI/LLM concepts
- ownership
- clear written and verbal communication
- collaboration in a distributed team
- Golang
- Rust
- Linux systems programming and profiling