Staff+ Software Engineer, Safeguards Human Review Tooling

Anthropic
San Francisco
Workplace: HybridFull timeUSD 320,000 - 485,000 annuallyFunction: Software EngineeringExperience: 8+ yearsEducation: bachelorsSkills: ["Communication","Cross-functional collaboration","Architecture and design","Operational focus","Product-mindedness"]

Build core tooling for AI safety investigations, review, and enforcement across first-party products and third-party cloud surfaces. Own both the user-facing tools and the underlying platform layer (APIs, storage, backend services, analytics, privacy-preserving primitives, and sandbox environments). Scale review with automation that leverages Claude while keeping humans in the loop, and instrument metrics to improve queue health, throughput, and decision quality. Partner with policy, operations, legal, privacy, and data science to make enforcement reliable and trustworthy.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Anthropic
Anthropic
2 months ago

Staff+ Software Engineer, Safeguards Human Review Tooling

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build core tooling for AI safety investigations, review, and enforcement across first-party products and third-party cloud surfaces. Own both the user-facing tools and the underlying platform layer (APIs, storage, backend services, analytics, privacy-preserving primitives, and sandbox environments). Scale review with automation that leverages Claude while keeping humans in the loop, and instrument metrics to improve queue health, throughput, and decision quality. Partner with policy, operations, legal, privacy, and data science to make enforcement reliable and trustworthy.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build investigation, review, and enforcement tooling including case queues, investigation views, decision and audit logging, and account-actioning workflows.
  • •Develop reusable APIs, data storage, and backend services that enable new review workflows to be stood up quickly and safely.
  • •Scale review through automation, including enabling reviewers to use Claude effectively and developing Claude-assisted review workflows.
  • •Partner with policy, operations, legal, privacy, and data science stakeholders to translate enforcement and investigation needs into reliable systems.
  • •Implement safety guardrails for internal tools, including granular permissions, audit trails, data-access controls, and reviewer wellbeing features; instrument metrics and evolve tooling with privacy/data-retention changes.

Pay and Benefits

Salary: USD 320,000 - 485,000 annually
Perks:EquityParental Leave

Key Requirements

  • •Technical background in full-stack or platform engineering, with strong architecture and design discussion skills.
  • •Experience shipping internal tools or platforms for demanding operational users, with measurable workflow improvements.
  • •Ability to work cross-functionally with operations, policy, or legal teams.
  • •Excellent communication skills, including explaining technical tradeoffs to non-technical stakeholders.
  • •A strong motivation to make AI systems safer and consider societal impacts.
Experience:8+ yearsAI safetyTrust and safetyHuman reviewLLMsAutomationPlatform engineering
Education:Bachelor's
Skills:CommunicationCross-functional collaborationArchitecture and designOperational focusProduct-mindedness
Languages:English

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Anthropic
Develops large-scale AI systems and safety research to create reliable, steerable, and interpretable AI assistants and models for commercial and research applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series C
Headquarters: San Francisco, United States
Founded: 2021
WebsiteLinkedIn