Staff Software Engineer, Inference

Anthropic
London
Workplace: OnsiteFull timeGBP 325,000 - 390,000 annuallyFunction: Software EngineeringEducation: bachelorsSkills: ["Communication","Problem-solving","Teamwork","Adaptability"]

Staff Software Engineer on the Inference team responsible for end-to-end infrastructure to serve Claude to millions of users. You’ll tackle distributed systems challenges, optimize LLM inference, and enable multi-accelerator deployments across multiple cloud platforms, contributing to high-performance, hardware-agnostic inference infrastructure and production pipelines.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
7 months ago

Staff Software Engineer, Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Staff Software Engineer on the Inference team responsible for end-to-end infrastructure to serve Claude to millions of users. You’ll tackle distributed systems challenges, optimize LLM inference, and enable multi-accelerator deployments across multiple cloud platforms, contributing to high-performance, hardware-agnostic inference infrastructure and production pipelines.
Location: London
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Identify and address infrastructure blockers to serve Claude to millions of users and enable breakthrough AI research
  • •Work on performance optimization, distributed systems, large-scale service orchestration, and intelligent request routing
  • •Contribute to LLM inference optimization, batching, and multi-accelerator deployments
  • •Design and maintain engineering solutions for routing, autoscaling, and deployment pipelines across regions
  • •Collaborate across teams to integrate new accelerator platforms and improve observability for production workloads

Pay and Benefits

Salary: GBP 325,000 - 390,000 annually
Equity and Bonus:Equity
Perks:Paid LeaveParental LeaveEquity

Key Requirements

  • •Significant software engineering experience, particularly with distributed systems
  • •Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments encouraged
  • •Experience with Kubernetes and cloud infrastructure (AWS, GCP)
  • •Proficiency in Python or Rust
  • •Strong results orientation with bias toward flexibility and impact
Experience:Distributed systemsCloud infrastructureAI infrastructure
Education:Bachelor's
Skills:CommunicationProblem-solvingTeamworkAdaptability
Languages:English
Tech Stack:KubernetesAWSGCPPythonRust

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn