Software Engineer, ML Developer Experience

Anyscale
San Francisco
Workplace: HybridFull timeUSD 226,000 - 283,000 annuallyFunction: Software EngineeringExperience: 5+ yearsEducation: bachelorsSkills: ["Product judgment","Strong product instincts","Willingness to understand users","Technical depth","Shipping developer-facing tools"]

Build and operate the ML Developer Experience layer of the Anyscale platform, enabling users and coding agents to discover, configure, run, observe, debug, and productionize AI workloads. You’ll work across the stack—from agent-first CLI/SDK/API/MCP surfaces to Workspaces and cloud infrastructure—designing scalable services that make failures across distributed jobs, tasks, actors, nodes, and GPUs easier to diagnose.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anyscale
Anyscale
1 day ago

Software Engineer, ML Developer Experience

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and operate the ML Developer Experience layer of the Anyscale platform, enabling users and coding agents to discover, configure, run, observe, debug, and productionize AI workloads. You’ll work across the stack—from agent-first CLI/SDK/API/MCP surfaces to Workspaces and cloud infrastructure—designing scalable services that make failures across distributed jobs, tasks, actors, nodes, and GPUs easier to diagnose.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Develop agent-first developer tooling and MLOps capabilities on Ray, including an agent-first CLI and cohesive SDK/API/MCP surfaces.
  • •Improve the path from local code to distributed execution across the Workspaces stack (environments, dependencies, images, authentication, workload submission, and debugging).
  • •Build end-to-end experience and tools for the AI development lifecycle (data preparation, fine-tuning, post-training, evaluation, serving, dataset management, experiment tracking, lineage).
  • •Surface observability across CLI, SDK, UI, and agent interfaces so users can diagnose failures across distributed jobs, tasks, actors, nodes, and GPUs.
  • •Design and operate highly available backend services and platform architecture across serverless and bring-your-own-cloud environments, including reliable model-to-endpoint workflows.

Pay and Benefits

Salary: USD 226,000 - 283,000 annually
Equity and Bonus:Equity

Key Requirements

  • •Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
  • •5+ years of experience writing high-quality production code.
  • •Solid background in algorithms, data structures, and system design.
  • •Experience working with modern machine learning tooling such as PyTorch and MLflow, plus data catalogs or similar tools.
  • •Hands-on experience building and operating highly available services in production.
Experience:5+ yearsDistributed computingMLOpsMachine learningOpen sourceAI workload production
Education:Bachelor's
Skills:Product judgmentStrong product instinctsWillingness to understand usersTechnical depthShipping developer-facing tools
Tech Stack:RayPyTorchMLflowOpenTelemetryOpenAI-compatible APIsCLISDKAPIMCPWorkspacesServerless

Company Brief

Anyscale
Provides a managed platform and developer tooling built on the Ray open-source project to scale Python and AI applications across clouds, simplifying distributed training, inference and production deployment for engineering teams.
Industry: Developer Tools
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor