Software Technical Leader - GenAI Gateway

Design and scale secure, high-impact GenAI Gateway systems, leading the technical strategy for LLM open-source inference serving. Build and optimize throughput and cost/latency using token compression, prompt caching, KV-cache optimization, and quantization. Develop core gateway components in Go with high availability and horizontal scalability, and mentor engineers by reviewing technical designs and raising code quality across the organization.