Senior Product Quality Analyst - AI Voice

Spotify
London
Workplace: RemoteFull timeFunction: Quality & Regulatory (Non-Software)Skills: ["Judgment","Communication","Independent work","Stakeholder management"]

Own the quality bar for Spotify’s AI voice models across products and languages. Define and measure “good enough” by creating evaluation rubrics and campaigns that combine qualitative judgments with MOS-style and quantitative assessment. Establish an ongoing evaluation cadence, benchmark against third-party models, and translate findings into actionable recommendations for Voice Production, Speak, product teams, and vendors.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Spotify
Spotify
2 days ago

Senior Product Quality Analyst - AI Voice

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Own the quality bar for Spotify’s AI voice models across products and languages. Define and measure “good enough” by creating evaluation rubrics and campaigns that combine qualitative judgments with MOS-style and quantitative assessment. Establish an ongoing evaluation cadence, benchmark against third-party models, and translate findings into actionable recommendations for Voice Production, Speak, product teams, and vendors.
Location: London
Workplace: Remote
Employment Type: Full time
Job Function: Quality & Regulatory (Non-Software)
Seniority: Mid level

Key Responsibilities

  • •Own the quality bar for Spotify’s AI voice models by defining what “good enough” means across products, audiences, languages, and use cases.
  • •Design evaluation rubrics and an evaluation approach that measures qualities such as naturalness, tone, pacing, pronunciation, accent, audio quality, and overall experience.
  • •Plan and run evaluation campaigns, translating qualitative and quantitative findings into recommendations for Voice Production, Speak, and product teams.
  • •Establish an ongoing evaluation rhythm, including reassessing model quality as technology and products evolve.
  • •Benchmark Spotify’s AI voices against third-party models and competitors to identify gaps and opportunities, and partner with experts, ML teams, product partners, and vendors to maintain a consistent quality bar.

Key Requirements

  • •Experience in product quality, evaluation, data curation, or a related field using human judgment to assess performance.
  • •Ability to independently define evaluation criteria and turn subjective qualities into clear, repeatable rubrics.
  • •Comfort designing and running qualitative and MOS-style evaluations, then synthesizing results into actionable insights.
  • •Understanding of voice or audio quality (e.g., naturalness, pacing, tone, accent, pronunciation) or ability to develop that expertise quickly.
  • •Strong judgment to maintain a consistent quality bar while balancing product requirements, markets, and stakeholder perspectives.
Skills:JudgmentCommunicationIndependent workStakeholder management

Company Brief

Spotify
Provides a music, podcast and audio streaming service offering on-demand access to millions of tracks and podcasts, personalized recommendations, and advertising and subscription-based tiers for listeners and creators worldwide.
Industry: Streaming Platforms
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Stockholm, Sweden
Founded: 2006
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor