Staff + Senior Software Engineer, Inference

Anthropic
Ontario
Workplace: RemoteFull timeFunction: Software EngineeringEducation: bachelorsSkills: ["Communication","Flexibility","Bias to impact","Collaboration","Learning mindset"]

Build and maintain the inference distributed systems that power Claude at massive scale. Own the full stack from intelligent request routing and load balancing across thousands of accelerators to fleet-wide orchestration and autoscaling for production, research, and experimental workloads. Develop deployment pipelines for releasing new models reliably, integrate new accelerator platforms, and improve performance using observability data in multi-region, multi-cloud environments.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
4 days ago

Staff + Senior Software Engineer, Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Build and maintain the inference distributed systems that power Claude at massive scale. Own the full stack from intelligent request routing and load balancing across thousands of accelerators to fleet-wide orchestration and autoscaling for production, research, and experimental workloads. Develop deployment pipelines for releasing new models reliably, integrate new accelerator platforms, and improve performance using observability data in multi-region, multi-cloud environments.
Location: Ontario
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design, build, and maintain distributed systems that serve Claude to millions of users.
  • •Develop resilient, flexible systems that adapt in real time to real-world events.
  • •Build intelligent request routing, load balancing, and traffic management across thousands of accelerators.
  • •Maximize compute efficiency using autoscaling and orchestration across production, research, and experimental workloads.
  • •Build and operate production-grade deployment pipelines for releasing new models to users.

Pay and Benefits

Perks:Parental LeavePaid Leave

Key Requirements

  • •Significant software engineering experience, particularly with distributed systems.
  • •Results-oriented approach with a bias towards flexibility and impact.
  • •Willingness to pick up slack, including tasks outside your job description.
  • •Desire to learn more about machine learning systems and infrastructure.
  • •Thrive in environments where technical excellence drives both business results and research breakthroughs.
Experience:Distributed systemsMachine learningLLM inference
Education:Bachelor's in A field relevant to the role as demonstrated through coursework, training, and/or professional experience
Skills:CommunicationFlexibilityBias to impactCollaborationLearning mindset
Languages:English
Tech Stack:PythonRustKubernetesAWSGCPAzure

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn