Staff + Senior Software Engineer, Inference

Anthropic
San Francisco, New York, Seattle
Workplace: OnsiteFull timeUSD 320,000 - 485,000 annuallyFunction: Software EngineeringEducation: bachelorsSkills: ["Pair programming","Collaboration","Problem-solving","Communication"]

Join the Inference team at Anthropic to design, build, and operate distributed, high-performance inference systems powering Claude for millions of users. You’ll work on intelligent request routing, fleet-wide orchestration across AI accelerators, and scalable deployment pipelines, enabling researchers to push the boundaries of next-generation models while maximizing compute efficiency.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
2 months ago

Staff + Senior Software Engineer, Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 22 hours agoStatus: Live

Job Summary

Join the Inference team at Anthropic to design, build, and operate distributed, high-performance inference systems powering Claude for millions of users. You’ll work on intelligent request routing, fleet-wide orchestration across AI accelerators, and scalable deployment pipelines, enabling researchers to push the boundaries of next-generation models while maximizing compute efficiency.
Location: San Francisco, New York, Seattle
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Design, build, and maintain the distributed systems that serve Claude to millions of users worldwide.
  • •Develop intelligent request routing, load balancing, and traffic management systems across thousands of accelerators.
  • •Maximize compute efficiency across the fleet by autoscaling and orchestrating production, research, and experimental workloads.
  • •Build and operate production-grade deployment pipelines for releasing new models to users.
  • •Provide high-performance inference infrastructure that enables researchers to develop next-generation models.

Pay and Benefits

Salary: USD 320,000 - 485,000 annually

Key Requirements

  • •Significant software engineering experience, particularly with distributed systems.
  • •Results-oriented, with a bias towards flexibility and impact.
  • •Willingness to pick up slack, even if it goes outside your job description.
  • •Enjoy pair programming.
  • •Desire to learn more about machine learning systems and infrastructure.
Experience:Distributed systemsAIInference
Education:Bachelor's
Skills:Pair programmingCollaborationProblem-solvingCommunication
Languages:English
Tech Stack:PythonRustKubernetesAWSGCPAzureLoad balancingTraffic managementInferenceDistributed systems

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn