Snorkel AI

1 day ago

Senior Manager, Forward Deployed Research

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Own how our data proves its value through rigorous benchmarking and tuning of frontier, customer, and open-source models. Lead a player-coach team to define evaluation methodology, metrics, and quality bars, partner with Engineering to build the tooling and automation, and translate benchmark gaps into clear evidence and next-build insights. Serve as the technical authority on evaluation while advancing presales materials and deal support with GTM.

Location: New York, Redwood City, San Francisco, United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Sr. Manager level

Key Responsibilities

•Own the system for measuring what our data does by defining how we benchmark and tune models on our data and the tooling/automation needed with Engineering.
•Recruit, hire, and develop a small team of engineers and researchers; stay hands-on while leading.
•Own the benchmarking and tuning methodology and playbook, including model panels, reported metrics, tuning setups, and quality bar.
•Turn benchmark results into gap intelligence to inform what to build next and support our data pitch.
•Tune customer and open-source models on our data to demonstrate lift and create presales material and intelligence, serving as evaluation technical authority.

Pay and Benefits

Salary: USD 185,000 - 321,600 annually

Equity and Bonus:Equity

Key Requirements

•8+ years in applied ML, model evaluation, or research-intensive engineering, with a track record of building technical systems.
•Strong software engineering skills for building data/evaluation pipelines, automation, and scalable tooling.
•Deep understanding of model evaluation and benchmarking, including designing evaluations and producing rigorous, defensible results.
•Fluency in frontier AI concepts such as LLMs and evaluation methodologies, including post-training techniques (RLHF, DPO, RLAIF).
•Experience leading, hiring, and developing technical talent in a player-coach model; comfort with ambiguity and rapid iteration.

Experience:Applied MLModel evaluationResearch-intensive engineeringFrontier AILLMs

Education:Bachelor's in Computer Science, Machine Learning, or related field

Skills:LeadershipTechnical communicationAnalytical thinkingCollaborationComfort with ambiguity

Tech Stack:LLMsRLHFDPORLAIFCoding agentsMultimodal modelsRL environments

Company Brief

Snorkel AI

Develops a programmatic data labeling platform and tools to accelerate machine learning by enabling teams to generate, manage, and maintain training datasets through weak supervision and automations.

Industry: Data Infrastructure

Company Size: Medium (51 to 250 employees)

Growth: Growth Stage Startup

Funding: Series C

Headquarters: Palo Alto, United States

Founded: 2019

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Snorkel AI

1 day ago

Senior Manager, Forward Deployed Research

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 19 hours agoStatus: Live

Job Summary

Location: New York, Redwood City, San Francisco, United States

Workplace: Hybrid

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Sr. Manager level

Key Responsibilities

•Own the system for measuring what our data does by defining how we benchmark and tune models on our data and the tooling/automation needed with Engineering.
•Recruit, hire, and develop a small team of engineers and researchers; stay hands-on while leading.
•Own the benchmarking and tuning methodology and playbook, including model panels, reported metrics, tuning setups, and quality bar.
•Turn benchmark results into gap intelligence to inform what to build next and support our data pitch.
•Tune customer and open-source models on our data to demonstrate lift and create presales material and intelligence, serving as evaluation technical authority.

Pay and Benefits

Salary: USD 185,000 - 321,600 annually

Equity and Bonus:Equity

Key Requirements

•8+ years in applied ML, model evaluation, or research-intensive engineering, with a track record of building technical systems.
•Strong software engineering skills for building data/evaluation pipelines, automation, and scalable tooling.
•Deep understanding of model evaluation and benchmarking, including designing evaluations and producing rigorous, defensible results.
•Fluency in frontier AI concepts such as LLMs and evaluation methodologies, including post-training techniques (RLHF, DPO, RLAIF).
•Experience leading, hiring, and developing technical talent in a player-coach model; comfort with ambiguity and rapid iteration.

Experience:Applied MLModel evaluationResearch-intensive engineeringFrontier AILLMs

Education:Bachelor's in Computer Science, Machine Learning, or related field

Skills:LeadershipTechnical communicationAnalytical thinkingCollaborationComfort with ambiguity

Tech Stack:LLMsRLHFDPORLAIFCoding agentsMultimodal modelsRL environments

Company Brief

Snorkel AI

Develops a programmatic data labeling platform and tools to accelerate machine learning by enabling teams to generate, manage, and maintain training datasets through weak supervision and automations.

Industry: Data Infrastructure

Company Size: Medium (51 to 250 employees)

Growth: Growth Stage Startup

Funding: Series C

Headquarters: Palo Alto, United States

Founded: 2019

Website LinkedIn