Software Engineer 2, AI Gateway

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8nnye0

Overview Join the AI Gateway engineering team to help build and evolve Kong's API management stack for AI and LLM workloads. You will shape core features like multi-LLM routing, semantic caching, and high-scale components, partnering with a distributed team to deliver reliable, low-latency capabilities. You’ll work on proxying, load balancing, and platform integrations, driving performance and robustness. This role offers the chance to influence how enterprises govern AI-driven API traffic at scale. A strong candidate brings hands-on systems expertise and a proactive, ownership-driven approach. Retribuzione / Benefits
* Equity
* Premio
* Health, dental, and vision insurance
* Paid holidays and PTO
* Professional development opportunities Responsabilità
* Build and maintain API management software for AI/LLM stacks
* Develop features such as proxying, load balancing, and database support for Kong AI Gateway
* Troubleshoot bugs, tune performance,



and perform low-level optimizations
* Bridge Kong with third-party deployment platforms and tooling
* Handle additional tasks as assigned by management Requisiti fondamentali
* 3+ years of server-side programming
* Hands-on experience with Golang or Rust
* Proven ability to build and debug highly scalable, distributed, reliable systems
* Strong Linux systems troubleshooting and profiling skills
* Experience with distributed systems and Linux networking on L7/L4
* Comfortable working in a globally distributed team
* Strong ownership and communication skills (documentation written by engineers)
* Familiarity with AI/LLM concepts
* ownership
* clear written and verbal communication
* collaboration in a distributed team
* Golang
* Rust
* Linux systems programming and profiling

Vedi l’offerta su Go Lavoro: golavoro.it/annuncio-lavoro/8nnye0