Senior Engineer, Inference Data Plane

Design and deliver high-scale, resilient AI inference data plane services for an “Inference as a Service” offering. Lead end-to-end system design for a multi-tenant inference cloud, optimize performance using distributed serving and KV-cache techniques, and build on Kubernetes-native frameworks. Collaborate with product and engineering teams, mentor junior engineers, contribute to upstream projects like vLLM and llm-d, and operate critical services with observability and SLOs.