Sr. Staff Machine Learning Systems Engineer

hims & hers
United States
Workplace: RemoteFull timeUSD 240,000 - 265,000 annuallyFunction: IT Operations (Systems/Network Admin)Experience: 10+ yearsSkills: ["Communication","Mentoring","Cross-team collaboration"]

Own end-to-end evaluation infrastructure and data pipelines for trustworthy AI in a regulated healthcare environment. Lead technical direction for metric/judge/scorer design, statistically rigorous regression gates, and adversarial red-team testing to reduce risk before models reach patients. Build and scale ingestion, dataset versioning, labeling/calibration workflows, and failure tracking/reporting surfaces so clinical and product teams can act on evaluation outcomes. Tackle ambiguous, cross-team problems and mentor engineers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
hims & hers
hims & hers
1 day ago

Sr. Staff Machine Learning Systems Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 7 hours agoStatus: Live

Job Summary

Own end-to-end evaluation infrastructure and data pipelines for trustworthy AI in a regulated healthcare environment. Lead technical direction for metric/judge/scorer design, statistically rigorous regression gates, and adversarial red-team testing to reduce risk before models reach patients. Build and scale ingestion, dataset versioning, labeling/calibration workflows, and failure tracking/reporting surfaces so clinical and product teams can act on evaluation outcomes. Tackle ambiguous, cross-team problems and mentor engineers.
Location: United States
Workplace: Remote
Employment Type: Full time
Job Function: IT Operations (Systems/Network Admin)
Seniority: Mid level

Key Responsibilities

  • •Set technical direction for evaluation systems, including metric/judge/scorer design, statistical regression methodology, and infrastructure that tracks failure modes over time.
  • •Design and scale data pipelines for evaluation and downstream work, including ingestion, transformation, dataset versioning, labeling and calibration workflows.
  • •Lead initiatives replacing inconsistent manual review processes with statistically sound automated gates for new AI services.
  • •Own adversarial and red-team evaluation as a risk-reduction program, including test suites and failure taxonomies.
  • •Turn ambiguous, cross-team problems into reusable standards and mentor engineers to raise the technical and statistical bar.

Pay and Benefits

Salary: USD 240,000 - 265,000 annually
Perks:Health InsuranceDentalVisionPaid LeaveParental Leave401kEquity

Key Requirements

  • •10+ years of experience building ML infrastructure, data engineering, or evaluation/testing systems with impact beyond a single team or project.
  • •Hands-on depth designing and calibrating LLM judges/scorers and building statistically sound regression-testing methodology, including regression testing and multiple-comparison correction.
  • •Hands-on depth building data pipeline engineering systems, including dataset versioning, feature/benchmark pipelines, and labeling/calibration workflows.
  • •Experience leading multi-team projects to completion and resolving technical disagreements across engineering, product, and AI leaders.
  • •Excellent communication skills and a track record of mentoring other engineers and raising technical and statistical bar.
Experience:10+ yearsML infrastructureData engineeringHealthcareRegulated industry
Skills:CommunicationMentoringCross-team collaboration
Tech Stack:PythonLLMDatabricksMLflowUnity CatalogSlack

Company Brief

hims & hers
A telehealth and consumer wellness platform offering personalized care and products across sexual health, hair, mental health, dermatology, weight loss and primary care via digital consultations, prescriptions, and fulfillment.
Industry: HealthTech
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Francisco, United States
Founded: 2017
Glassdoor
Glassdoor: 2.9
WebsiteLinkedInGlassdoor