Senior Software Engineer, Inference

Anthropic
London
Workplace: OnsiteFull timeGBP 225,000 - 325,000 annuallyFunction: Software EngineeringEducation: bachelorsSkills: ["Distributed systems","Communication","Problem-solving"]

Lead the design and maintenance of high-performance, distributed inference systems for Claude, focusing on scalable request routing, fleet-wide orchestration across AI accelerators, and production-grade deployment pipelines. Collaborate with researchers and engineers to maximize compute efficiency across multi-region deployments on AWS/GCP, using Python or Rust to enable breakthrough ML in a hardware-agnostic environment.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
4 months ago

Senior Software Engineer, Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Lead the design and maintenance of high-performance, distributed inference systems for Claude, focusing on scalable request routing, fleet-wide orchestration across AI accelerators, and production-grade deployment pipelines. Collaborate with researchers and engineers to maximize compute efficiency across multi-region deployments on AWS/GCP, using Python or Rust to enable breakthrough ML in a hardware-agnostic environment.
Location: London
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Design intelligent routing algorithms that optimize request distribution across thousands of accelerators
  • •Autoscale compute fleets to match supply and demand across production, research, and experimental workloads
  • •Build production-grade deployment pipelines for releasing new models to millions of users
  • •Integrate new AI accelerator platforms to maintain hardware-agnostic competitive advantage
  • •Contribute to new inference features (e.g., structured sampling, prompt caching)

Pay and Benefits

Salary: GBP 225,000 - 325,000 annually

Key Requirements

  • •Significant software engineering experience with distributed systems
Experience:Distributed systemsInference
Education:Bachelor's
Skills:Distributed systemsCommunicationProblem-solving
Languages:English
Tech Stack:KubernetesAWSGCPPythonRust

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn