Software Engineer, Ray Serve
Bengaluru
Full timeFunction: Software EngineeringSkills: ["Python","C++","Cython","GRPC","Kubernetes","OpenTelemetry","Prometheus","TensorFlow","PyTorch","JAX","Transformers"]Join Anyscale to build high-performance ML serving systems at scale. You’ll work on Ray Serve, tackling distributed systems challenges at the intersection of AI, ML frameworks, and production infrastructure, delivering asynchronous inference, ultra-low-latency routing, zero-downtime model updates, scalable state management, and multi-model orchestration for millions of users.
