Safety Operations Lead

Thinking Machines Lab
San Francisco
Workplace: HybridFull timeUSD 190,000 - 300,000 annuallyFunction: Business OperationsExperience: 7+ yearsSkills: ["Policy judgment","Stakeholder collaboration","Case pattern analysis","Observability and detection","Speed and learning"]

Own safety operations for human-AI collaboration products by triaging a daily moderation queue and taking enforcement actions on flagged content and abuse signals. Turn recurring case patterns into safety policy, tooling, and automation that improve consistency and speed across the product stack. Partner with product, engineering, legal, safety research, and security teams to embed protections (e.g., refusals and account review) and improve observability and detection for safety-relevant events.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Thinking Machines Lab
Thinking Machines Lab
19 hours ago

Safety Operations Lead

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Own safety operations for human-AI collaboration products by triaging a daily moderation queue and taking enforcement actions on flagged content and abuse signals. Turn recurring case patterns into safety policy, tooling, and automation that improve consistency and speed across the product stack. Partner with product, engineering, legal, safety research, and security teams to embed protections (e.g., refusals and account review) and improve observability and detection for safety-relevant events.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Business Operations
Seniority: Mid level

Key Responsibilities

  • •Review flagged content, safety escalations, and account-level abuse signals daily; triage cases and take action (content flags, account review, bans/recovery).
  • •Design and refine safety policy across the product stack using patterns from casework, coordinating with engineering, legal, safety research, and security stakeholders.
  • •Build and maintain tooling and automation to make casework faster and more consistent (triage agents, ban/recovery workflows, abuse detection frameworks and templates).
  • •Embed safety into the product experience with product teams, including model refusals, content flagging, account review, and safety protections.
  • •Improve observability and detection for safety-relevant events (model safety trends, abuse patterns, malicious production behavior) to surface cases faster with better signal.

Pay and Benefits

Salary: USD 190,000 - 300,000 annually
Perks:Health InsuranceDentalVisionPaid LeaveParental LeaveRelocation

Key Requirements

  • •7+ years in operational trust & safety, content moderation, or fraud/abuse ops with direct, recurring responsibility for a case queue.
  • •Own policy definition, operationalization, and end-to-end enforcement using specific policies or enforcement programs you built or ran.
  • •Direct case experience with cybersecurity abuse, CBRN-relevant risk, youth safety, or prompt injection in a production environment.
  • •Familiarity with model safety and abuse risk categories (jailbreaks, prompt injection, scaled abuse) and how to identify and mitigate them in a live product.
  • •Practical experience using AI tools (Claude, Codex, or similar) to build or accelerate operational workflows.
Experience:7+ yearsContent moderationTrust & safetyFraud/abuse opsAI safetyLLMProduction environment
Skills:Policy judgmentStakeholder collaborationCase pattern analysisObservability and detectionSpeed and learning
Tech Stack:ClaudeCodexLLM APIs

Eligibility

Work Authorization:Sponsorship available.

Company Brief

Thinking Machines Lab
Develops enterprise AI solutions, custom large language models, and ML platforms to help organizations deploy intelligent applications. Services include data engineering, model development, and AI consulting for scale and production readiness.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Mumbai, India
Website