Anthropic

1 month ago

Staff + Sr. Software Engineer, Cloud Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 20 hours agoStatus: Live

Job Summary

Join the Cloud Inference team to scale and optimize Claude across AWS, GCP, and Azure. Build backend services and tooling to run on multiple cloud platforms, drive CI/CD for rapid model releases, and optimize resource usage with cross-functional teams. You’ll influence provider roadmaps, ensure safety and performance, and operate at massive scale with autonomous, end-to-end ownership.

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Design, build, and own backend services and infrastructure that serve Claude across multiple CSPs, accounting for differences in compute hardware, networking, APIs, and operational models.
•Work cross-functionally with internal inference, product API, systems, and security teams, among others, and with CSP partners to stand up the full serving stack on new cloud platforms, resolve operational issues, and influence provider roadmaps.
•Build and evolve CI/CD automation systems, including validation and deployment pipelines, that reliably ship new model versions to millions of users across cloud platforms without regressions.
•Design interfaces and tooling abstractions across CSPs that enable cost-effective inference management, scale across providers, and reduce per-platform complexity.
•Contribute to capacity planning, autoscaling, and workload routing strategies that match supply with demand and direct requests to the most cost-effective accelerator and region.

Pay and Benefits

Salary: USD 320,000 - 485,000 annually

Key Requirements

•Have significant software engineering experience, with a strong background in high-performance, large-scale distributed systems serving millions of users.
•Have experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure), with exposure to Kubernetes, Infrastructure as Code, or container orchestration.
•Are curious about LLM serving; prior inference or ML experience is not required.
•Thrive in cross-functional collaboration with both internal teams and external partners.
•Have experience working with external partners to align goals and deliver impact.

Experience:AICloud

Education:Bachelor's

Skills:Cross-functional collaborationHigh-performanceDistributed systemsAutonomyOwnership

Languages:English

Tech Stack:PythonRustKubernetesAWSGCPAzureCI/CDInfrastructure as CodeContainer orchestration

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic

Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series C

Headquarters: San Francisco, United States

Founded: 2021

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Anthropic

1 month ago

Staff + Sr. Software Engineer, Cloud Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 20 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Design, build, and own backend services and infrastructure that serve Claude across multiple CSPs, accounting for differences in compute hardware, networking, APIs, and operational models.
•Work cross-functionally with internal inference, product API, systems, and security teams, among others, and with CSP partners to stand up the full serving stack on new cloud platforms, resolve operational issues, and influence provider roadmaps.
•Build and evolve CI/CD automation systems, including validation and deployment pipelines, that reliably ship new model versions to millions of users across cloud platforms without regressions.
•Design interfaces and tooling abstractions across CSPs that enable cost-effective inference management, scale across providers, and reduce per-platform complexity.
•Contribute to capacity planning, autoscaling, and workload routing strategies that match supply with demand and direct requests to the most cost-effective accelerator and region.

Pay and Benefits

Salary: USD 320,000 - 485,000 annually

Key Requirements

•Have significant software engineering experience, with a strong background in high-performance, large-scale distributed systems serving millions of users.
•Have experience building or operating services on at least one major cloud platform (AWS, GCP, or Azure), with exposure to Kubernetes, Infrastructure as Code, or container orchestration.
•Are curious about LLM serving; prior inference or ML experience is not required.
•Thrive in cross-functional collaboration with both internal teams and external partners.
•Have experience working with external partners to align goals and deliver impact.

Experience:AICloud

Education:Bachelor's

Skills:Cross-functional collaborationHigh-performanceDistributed systemsAutonomyOwnership

Languages:English

Tech Stack:PythonRustKubernetesAWSGCPAzureCI/CDInfrastructure as CodeContainer orchestration

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic

Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Valuation: Unicorn (USD 1B+)

Funding: Series C

Headquarters: San Francisco, United States

Founded: 2021

Website LinkedIn