Pre-training Distributed Systems Tech Lead / Manager

Anthropic
San Francisco
Workplace: HybridFull timeUSD 500,000 - 850,000 annuallyFunction: Administration & Executive AssistanceEducation: bachelorsSkills: ["Communication","Leadership","Coaching","Prioritization"]

Own the infrastructure that enables safe, scalable AI model evaluations. You’ll lead distributed systems that schedule and orchestrate evals for frontier model training, drive eval throughput and cost, and build the harnesses researchers use to design, run, and iterate on evaluations. Ensure results are trustworthy through determinism, reproducibility, and uncertainty quantification, and partner with researchers so evaluation signal reaches launch decision dashboards.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
1 month ago

Pre-training Distributed Systems Tech Lead / Manager

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Own the infrastructure that enables safe, scalable AI model evaluations. You’ll lead distributed systems that schedule and orchestrate evals for frontier model training, drive eval throughput and cost, and build the harnesses researchers use to design, run, and iterate on evaluations. Ensure results are trustworthy through determinism, reproducibility, and uncertainty quantification, and partner with researchers so evaluation signal reaches launch decision dashboards.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Lead the team building distributed systems that schedule, orchestrate, and execute evals for frontier model training.
  • •Own eval throughput and cost, including compute allocation, queueing against constrained accelerator pools, and caching/reuse of eval work.
  • •Build and scale the harnesses researchers use to define, run, and iterate on evals.
  • •Ensure eval results are trustworthy with determinism, reproducibility, and honest uncertainty quantification on reported metrics.
  • •Ensure eval signal reaches dashboards and reviews used for launch decisions while contributing as an engineer and coaching reports.

Pay and Benefits

Salary: USD 500,000 - 850,000 annually
Perks:Paid LeaveParental Leave

Key Requirements

  • •Have led technical projects end-to-end on large-scale distributed systems and have 1+ years managing engineers (or equivalent tech-lead-with-reports experience).
  • •Be strong in Python and Rust.
  • •Build high-throughput, fault-tolerant systems on cloud or on-prem accelerator fleets.
  • •Care deeply about measurement quality, including noticing when metrics change for the wrong reasons.
  • •Communicate well with researchers and translate research needs into infrastructure.
Experience:AI researchLLMLLM evaluationDistributed systemsCloud infrastructure
Education:Bachelor's
Skills:CommunicationLeadershipCoachingPrioritization
Languages:English
Tech Stack:PythonRust

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn