Senior AI Product Manager, Leaderboard

Scale AI
New York, San Francisco
Workplace: OnsiteFull timeUSD 205,600 - 257,000 annuallyFunction: Product ManagementSkills: ["Product judgment","Operational rigor","Stakeholder management","Executive communication","Analytical thinking"]

Own and scale the SEAL Leaderboard portfolio by defining strategy, roadmap, and operational excellence for evaluation products, benchmarks, and public/private leaderboards. Lead governance and lifecycle decisions from ideation and benchmark design through launch, growth, maintenance, and sunset. Partner with ML researchers, engineering, operations, and GTM to develop trustworthy evaluation methodologies and drive adoption, customer impact, and measurable business outcomes.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Scale AI
Scale AI
6 days ago

Senior AI Product Manager, Leaderboard

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Own and scale the SEAL Leaderboard portfolio by defining strategy, roadmap, and operational excellence for evaluation products, benchmarks, and public/private leaderboards. Lead governance and lifecycle decisions from ideation and benchmark design through launch, growth, maintenance, and sunset. Partner with ML researchers, engineering, operations, and GTM to develop trustworthy evaluation methodologies and drive adoption, customer impact, and measurable business outcomes.
Location: New York, San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Product Management
Seniority: Mid level

Key Responsibilities

  • •Own the roadmap and strategy for the SEAL Leaderboard portfolio, setting priorities across benchmark development, launches, infrastructure investments, and product expansion.
  • •Facilitate the Leaderboard Steering Committee and drive alignment across AI-PM, ML, Engineering, Operations, and GTM stakeholders.
  • •Evaluate, prioritize, and operationalize new leaderboard proposals, ensuring alignment with customer demand, market opportunities, and company strategy.
  • •Manage the end-to-end leaderboard product lifecycle from ideation and benchmark design through launch, growth, maintenance, and sunset decisions.
  • •Work with ML researchers and domain experts to develop trustworthy evaluation methodologies, benchmark specifications, and leaderboard scoring frameworks.

Pay and Benefits

Salary: USD 205,600 - 257,000 annually
Perks:Health InsuranceDentalVisionRetirement BenefitsLearning BudgetPaid LeaveCommuter Benefits

Key Requirements

  • •5+ years of experience in product management, technical program management, consulting, or customer-facing technical roles.
  • •Strong technical fluency with machine learning systems, AI model evaluation, benchmarking, or data products.
  • •Experience building and scaling products requiring cross-functional coordination across engineering, operations, and business teams.
  • •Excellent stakeholder management and executive communication skills to drive alignment across cross-functional organizations.
  • •Strong analytical skills to translate ambiguous market and customer signals into product strategy.
Experience:AIMachine learningProduct managementBenchmarkingData products
Skills:Product judgmentOperational rigorStakeholder managementExecutive communicationAnalytical thinking
Languages:English
Tech Stack:Machine learningAI model evaluationBenchmarkingLeaderboardsData productsEvaluation frameworksAutomationOperational tooling

Company Brief

Scale AI
Provides data labeling, annotation, and infrastructure services to accelerate machine learning and AI development. Supplies high-quality training data, tooling, and APIs for customers in autonomous vehicles, mapping, robotics, and enterprise AI applications.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2016
WebsiteLinkedIn