Senior Product Manager, Multilingual AI and Evals

OKX
Singapore
Workplace: OnsiteFull timeFunction: Product ManagementExperience: 3+ yearsEducation: bachelorsSkills: ["Cross-functional leadership"]

Own QA and evaluation for multilingual AI agents powering an AI-native localization stack. You’ll enhance the quality gate for auto-publishing translations, build AI-driven localization testing tools to catch issues like truncation and format errors, and create the evaluation/annotation infrastructure (golden datasets, error classification, metrics, feedback loops) that continuously improves agent performance at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OKX
OKX
1 month ago

Senior Product Manager, Multilingual AI and Evals

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Own QA and evaluation for multilingual AI agents powering an AI-native localization stack. You’ll enhance the quality gate for auto-publishing translations, build AI-driven localization testing tools to catch issues like truncation and format errors, and create the evaluation/annotation infrastructure (golden datasets, error classification, metrics, feedback loops) that continuously improves agent performance at scale.
Location: Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Product Management
Seniority: Mid level

Key Responsibilities

  • •Enhance the quality gate of the agentic pipeline that decides whether translations are good enough to auto-publish.
  • •Diagnose systematic issues when the gate fails and drive fixes back into the agent.
  • •Build an AI-driven product testing tool to detect localization defects that review can’t catch (e.g., truncation, layout breakage, hardcoded strings, unlocalized images, wrong formats).
  • •Ship an MVP that scans mobile/web apps for localization auditing and integrate localization tests into internal product testing infrastructure.
  • •Build evaluation and annotation infrastructure (golden datasets, error classification tooling, automated evaluation, metrics/dashboard, and human-to-agent feedback loops).

Pay and Benefits

Perks:Health InsuranceMeal AllowanceLearning Budget

Key Requirements

  • •Bachelor's degree or higher with 3+ years in product management.
  • •Hands-on experience building or evaluating AI agent systems (not just using AI tools).
  • •Platform-building experience turning fuzzy workflows into systems others rely on (e.g., CMS, testing infrastructure, internal tooling).
  • •Experience with AI agents, agent harnesses, and evals for subjective, hard-to-measure quality problems; ability to design eval harnesses and golden datasets.
  • •Multi-market shipping experience across multiple markets or languages, working cross-culturally with distributed teams.
Experience:3+ yearsAI agentsLocalizationMultilingualSaaS
Education:Bachelor's
Skills:Cross-functional leadership
Languages:English
Tech Stack:AI-native localization stackPhraseSmartlingICUCLDR

Company Brief

OKX
Global cryptocurrency exchange and Web3 technology provider offering spot and derivatives trading, custody, wallet services, and blockchain infrastructure to retail and institutional users worldwide.
Industry: Trading Platforms
Company Size: Enterprise (1,001+ employees)
Growth: Established Company
Headquarters: Victoria, Seychelles
Founded: 2017
WebsiteLinkedIn