Senior Product Quality Analyst - AI Voice

Spotify
New York, Los Angeles
Workplace: RemoteFull timeUSD 114,486 - 163,552 annuallyFunction: Quality & Regulatory (Non-Software)Skills: ["Judgment","Communication","Independent problem-solving","Stakeholder management","Autonomy"]

Own evaluation of Spotify’s AI voice quality by defining and measuring what “good enough” means across products, audiences, languages, and use cases. Design evaluation rubrics and campaigns using qualitative judgment and MOS-style methods, turn findings into actionable recommendations, and establish an ongoing evaluation cadence. Benchmark against third-party models, balance quality trade-offs for new markets, and partner with voice experts, ML teams, product stakeholders, and vendors.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Spotify
Spotify
2 days ago

Senior Product Quality Analyst - AI Voice

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Own evaluation of Spotify’s AI voice quality by defining and measuring what “good enough” means across products, audiences, languages, and use cases. Design evaluation rubrics and campaigns using qualitative judgment and MOS-style methods, turn findings into actionable recommendations, and establish an ongoing evaluation cadence. Benchmark against third-party models, balance quality trade-offs for new markets, and partner with voice experts, ML teams, product stakeholders, and vendors.
Location: New York, Los Angeles
Workplace: Remote
Employment Type: Full time
Job Function: Quality & Regulatory (Non-Software)
Seniority: Mid level

Key Responsibilities

  • •Own the quality bar for Spotify’s AI voice models by defining what “good enough” means for different products, audiences, languages, and use cases.
  • •Independently design evaluation rubrics and an evaluation approach measuring qualities like naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience.
  • •Plan and run evaluation campaigns, translating qualitative and quantitative findings into recommendations for Voice Production, Speak, and product teams.
  • •Establish an ongoing evaluation rhythm to reassess model quality as technology and products evolve.
  • •Benchmark Spotify’s AI voices against third-party models and competitors to identify where experiences lead, differ, and can improve.

Pay and Benefits

Salary: USD 114,486 - 163,552 annually
Equity and Bonus:Equity
Perks:Health InsurancePaid Parental401kMeal AllowancePaid Leave

Key Requirements

  • •Experience in product quality, evaluation, data curation, or a related field using human judgment to assess performance.
  • •Ability to define evaluation criteria independently and convert subjective qualities into clear, repeatable rubrics.
  • •Comfort designing and running qualitative and MOS-style evaluations, then synthesizing results into actionable insights.
  • •Understanding of voice or audio quality (e.g., naturalness, pacing, tone, accent, pronunciation) or ability to develop that expertise quickly.
  • •Strong communication across creative, technical, and product teams, serving as a reliable point of contact for internal partners and external vendors.
Skills:JudgmentCommunicationIndependent problem-solvingStakeholder managementAutonomy

Company Brief

Spotify
Provides a music, podcast and audio streaming service offering on-demand access to millions of tracks and podcasts, personalized recommendations, and advertising and subscription-based tiers for listeners and creators worldwide.
Industry: Streaming Platforms
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Stockholm, Sweden
Founded: 2006
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor