Staff Software Engineer, Inference

Anthropic
Dublin
Workplace: OnsiteFull timeEUR 295,000 - 355,000 annuallyFunction: Software EngineeringEducation: bachelorsSkills: ["Collaboration","Communication","Problem-solving","Teamwork","Adaptability"]

Lead end-to-end development of high-performance inference infrastructure for Claude, tackling distributed systems, large-scale service orchestration, and multi-accelerator deployments. You’ll optimize compute, design intelligent request routing, and build production pipelines to support millions of users and cutting-edge ML research across cloud platforms using Kubernetes, AWS, and GCP.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
4 months ago

Staff Software Engineer, Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Lead end-to-end development of high-performance inference infrastructure for Claude, tackling distributed systems, large-scale service orchestration, and multi-accelerator deployments. You’ll optimize compute, design intelligent request routing, and build production pipelines to support millions of users and cutting-edge ML research across cloud platforms using Kubernetes, AWS, and GCP.
Location: Dublin
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Design and implement intelligent routing algorithms to optimize request distribution across thousands of accelerators
  • •Build and manage autoscaling for compute fleet across production, research, and experimental workloads
  • •Develop production-grade deployment pipelines for releasing new models to millions of users
  • •Integrate new AI accelerator platforms to maintain hardware-agnostic advantages
  • •Contribute to inference features (e.g., structured sampling, prompt caching) and support inference for new model architectures

Pay and Benefits

Salary: EUR 295,000 - 355,000 annually

Key Requirements

  • •Significant software engineering experience with distributed systems
  • •Experience with Kubernetes and cloud infrastructure (AWS, GCP)
  • •Proficiency in Python or Rust
  • •Familiarity with LLM inference optimization, batching strategies, and multi-accelerator deployments is encouraged
  • •Strong collaboration and impact-driven mindset
Experience:Distributed systemsCloud computingAI infrastructure
Education:Bachelor's
Skills:CollaborationCommunicationProblem-solvingTeamworkAdaptability
Languages:English
Tech Stack:KubernetesAWSGCPPythonRustLLM inferenceBatchingMulti-acceleratorInference pipelines

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn