Software Engineer, Infrastructure

Anyscale
San Francisco, Palo Alto
Workplace: OnsiteFull timeUSD 202,000 - 237,000 annuallyFunction: Software EngineeringExperience: 3+ yearsEducation: bachelorsSkills: []

Join the Infrastructure team to build the control plane and high-performance data plane powering distributed AI workloads. Design and scale services that orchestrate Ray clusters across cloud and on-prem, create intelligent scheduling and resource management, and improve reliability, performance, scalability, and observability. Work with Kubernetes/container orchestration and cloud-native infrastructure, integrate accelerators like GPUs/TPUs, and support production systems through on-call troubleshooting.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anyscale
Anyscale
1 month ago

Software Engineer, Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 11 hours agoStatus: Live

Job Summary

Join the Infrastructure team to build the control plane and high-performance data plane powering distributed AI workloads. Design and scale services that orchestrate Ray clusters across cloud and on-prem, create intelligent scheduling and resource management, and improve reliability, performance, scalability, and observability. Work with Kubernetes/container orchestration and cloud-native infrastructure, integrate accelerators like GPUs/TPUs, and support production systems through on-call troubleshooting.
Location: San Francisco, Palo Alto
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design, build, and scale services that orchestrate Ray clusters across cloud and on-prem, supporting both VM-based and Kubernetes-based deployments.
  • •Optimize control plane components for large-scale, distributed AI/ML workloads.
  • •Build intelligent scheduling and resource management systems for heterogeneous compute clusters.
  • •Develop features to improve reliability, performance, scalability, and observability of Anyscale-managed Ray workloads.
  • •Provide on-call support and troubleshoot infrastructure issues with customer and field teams.

Pay and Benefits

Salary: USD 202,000 - 237,000 annually
Equity and Bonus:Equity

Key Requirements

  • •Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
  • •3+ years of experience writing high-quality production code.
  • •Hands-on experience building and maintaining highly available, scalable, performant distributed systems.
  • •Expertise in cloud-native technologies (AWS, Azure, GCP) and Kubernetes-based deployments.
  • •Proficiency in Go and Python, plus familiarity with observability stacks like Prometheus and Grafana.
Experience:3+ yearsDistributed computingDistributed systemsMachine learningCloud infrastructureOpen source
Education:Bachelor's
Tech Stack:RayKubernetesContainer orchestrationAWSAzureGCPPrometheusGrafanaGoPythonLinux kernelFile systemsContainersGPUsTPUs

Company Brief

Anyscale
Provides a managed platform and developer tooling built on the Ray open-source project to scale Python and AI applications across clouds, simplifying distributed training, inference and production deployment for engineering teams.
Industry: Developer Tools
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor