Software Engineer AI Gateway

Kong
Milan
Workplace: HybridFull timeFunction: Software EngineeringExperience: 3+ yearsSkills: ["Golang","Rust","Linux","Networking","APIs","LLM","AI","Distributed systems"]

Join the AI Gateway team to build and maintain API management software for AI and LLMs, enabling scalable, distributed deployments. You’ll implement features like multi-LLM routing, semantic caching, and load balancing, while profiling and optimizing performance. Collaborate with a remote team to bridge Kong with third-party platforms, write documentation, and push the boundaries of AI-enabled API infrastructure.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Kong
Kong
3 months ago

Software Engineer AI Gateway

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Join the AI Gateway team to build and maintain API management software for AI and LLMs, enabling scalable, distributed deployments. You’ll implement features like multi-LLM routing, semantic caching, and load balancing, while profiling and optimizing performance. Collaborate with a remote team to bridge Kong with third-party platforms, write documentation, and push the boundaries of AI-enabled API infrastructure.
Location: Milan
Workplace: Hybrid
Employment Type: Full time · Permanent
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build and maintain API management software for AI and LLMs and its underlying stack.
  • •Implement new features including proxying capabilities, load balancing, and databases support that extend Kong AI Gateway’s offering.
  • •Troubleshoot bugs, tune performance, and perform low-level optimizations.
  • •Bridge gaps between Kong and third-party deployment platforms and tooling.
  • •Perform any additional tasks required by the manager.

Key Requirements

  • •3+ years of programming in server-side applications and components
  • •Hands on experience with either Golang or Rust
  • •Experience building and debugging applications that are highly scalable, distributed, reliable and resilient
  • •Solid hands-on low-level technical expertise in Linux systems troubleshooting, and profiling
  • •Experience in distributed systems, Linux networking stack and computer systems programming, Kong works with APIs on both L7 and L4 transports and protocols
Experience:3+ yearsAILLMDistributed systemsAPI gatewayKong
Skills:GolangRustLinuxNetworkingAPIsLLMAIDistributed systems
Tech Stack:GolangRustLinuxNGINX/OpenResty/Kong/LuaJITEnvoyIstio

Company Brief

Kong
Provides a cloud-native API and service connectivity platform (Kong Gateway, Konnect, Kuma, Insomnia) that secures, manages, and observes APIs and microservices for enterprises across cloud and hybrid environments.
Industry: API Platforms
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2017
Glassdoor
Glassdoor: 3.9
WebsiteLinkedInGlassdoor