Senior | Staff Software Engineer - AI / ML

Snorkel AI
San Francisco
Workplace: HybridFull timeUSD 208,000 - 315,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["Communication","Hypothesis testing","Problem-solving","Scientific thinking"]

Help make frontier AI data generation and evaluation faster, cheaper, and more rigorous as an early member of ML & Research Engineering. You’ll study how production data is generated and evaluated, form and test hypotheses against real workloads, and ship scalable winners. Focus areas include efficient agentic evals, AI model routing for cost/quality tradeoffs, fine-tuning and serving open-weight models, predictive difficulty, and measurement for LLM-as-judge systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Snorkel AI
Snorkel AI
1 day ago

Senior | Staff Software Engineer - AI / ML

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Help make frontier AI data generation and evaluation faster, cheaper, and more rigorous as an early member of ML & Research Engineering. You’ll study how production data is generated and evaluated, form and test hypotheses against real workloads, and ship scalable winners. Focus areas include efficient agentic evals, AI model routing for cost/quality tradeoffs, fine-tuning and serving open-weight models, predictive difficulty, and measurement for LLM-as-judge systems.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Make frontier AI data generation and evaluation faster, cheaper, and more rigorous using ML and AI
  • •Study how frontier-grade data is generated and evaluated; form hypotheses and validate them on real production data
  • •Build efficient agentic evaluation systems using adaptive sampling, early stopping, model cascades, caching, and cheap-first gating
  • •Design AI model routing to send eval and judge calls to the cheapest model that meets quality, with fallback, monitoring, and cost attribution
  • •Create measurement systems for AI data, including golden datasets and reproducible LLM-as-judge accuracy and calibration

Pay and Benefits

Salary: USD 208,000 - 315,000 annually

Key Requirements

  • •5+ years building production ML or software systems with end-to-end ownership from prototype to production
  • •Hands-on experience running LLM or ML workloads in production, with comfort reasoning about non-deterministic systems
  • •Deep grounding in statistics and experimentation, including experiment design, hypothesis testing, sampling, and confidence intervals
  • •Strong Python and software engineering fundamentals, including testing, code review, and system design
  • •Experience designing evaluations and interpreting results rigorously
Experience:5+ years
Skills:CommunicationHypothesis testingProblem-solvingScientific thinking
Languages:English
Tech Stack:PythonLLMMLLoRA

Company Brief

Snorkel AI
Develops a programmatic data labeling platform and tools to accelerate machine learning by enabling teams to generate, manage, and maintain training datasets through weak supervision and automations.
Industry: Data Infrastructure
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Funding: Series C
Headquarters: Palo Alto, United States
Founded: 2019
WebsiteLinkedIn