Evaluations Engineering - Member of Technical Staff
Simile
San Francisco
Workplace: OnsiteFull timeUSD 200,000 - 400,000 annuallyFunction: Software EngineeringSkills: ["Ownership","Communication","Collaboration","System design"]Build evaluation infrastructure and tooling for a foundation model that simulates human behavior. You’ll design reliable, reproducible systems to run evaluations across datasets and model versions, strengthen evaluation data schemas with provenance and access controls, and automate validation, survey operations, and human data workflows. Partner across Evals, Modeling, Product Engineering, and Data Operations to deliver execution pipelines, orchestration, and interfaces that help teams compare models and detect regressions.

