Software Engineer 2, AI Gateway

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8o2z3m

Overview

Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach.

Retribuzione / Benefits

- Equity
- Premio
- Health, dental, and vision insurance
- Paid holidays and PTO
- Professional development opportunities

Responsabilità

- Build and maintain API management software for AI/LLM stacks
- Develop features such as proxying, load balancing, and database support for Kong AI Gateway
- Troubleshoot bugs, tune performance,



and perform low-level optimizations
- Bridge Kong with third-party deployment platforms and tooling
- Handle additional tasks as assigned by management

Requisiti fondamentali

- 3+ years of server-side programming
- Hands-on experience with Golang or Rust
- Proven ability to build and debug highly scalable, distributed, reliable systems
- Strong Linux systems troubleshooting and profiling skills
- Experience with distributed systems and Linux networking on L7/L4
- Comfortable working in a globally distributed team
- Strong ownership and communication skills (documentation written by engineers)
- Familiarity with AI/LLM concepts

- ownership
- clear written and verbal communication
- collaboration in a distributed team
- Golang
- Rust
- Linux systems programming and profiling

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8o2z3m