OKX

2 days ago

Senior Product Manager, Agent QA & Localization Quality

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Own the Agent QA quality system for an AI-native localization stack. You’ll build AI-driven testing tools to detect localization defects in mobile/web apps, enhance the quality gate that decides when translations can auto-publish, and create the evaluation and annotation infrastructure (golden datasets, error classification, metrics dashboards, and RLHF feedback) that makes quality measurable and continuously improvable at scale.

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Product Management

Seniority: Mid level

Key Responsibilities

•Build an AI-driven localization testing tool to detect defects translation review can’t catch and ship an MVP that scans mobile/web apps, then integrate tests into internal product testing so they run before releases.
•Enhance the agentic pipeline quality gate that decides whether translations are safe to auto-publish, managing automation-versus-risk trade-offs and driving fixes into the agent when failures are systematic.
•Create evaluation and annotation infrastructure: golden datasets, error classification, automated evaluation, a metrics/dashboard layer, and an RLHF feedback loop to turn human evaluations into agent fine-tuning.
•Own annotation workflow integration (e.g., with internal AI infrastructure) so linguists can annotate in a standardized, real-time way.

Pay and Benefits

Perks:Learning BudgetMeal AllowanceHealth InsuranceWellness StipendRemote Work

Key Requirements

•5+ years in product or program management with hands-on localization experience, including terminology/glossary management, AI translation workflows, Translation Management Systems (e.g., Phrase, Smartling), internationalization (ICU/CLDR), and international launches.
•Demonstrated experience shipping AI/ML or evaluation-driven products (or internal tooling) and partnering deeply with AI teams.
•Hands-on fluency with LLM evaluation and eval-driven development: eval harnesses/golden datasets, prompt & QE design, precision/recall tuning, and diagnosing failure modes.
•Strong data fluency to define metric frameworks and dashboards, including precision/recall trade-offs for fuzzy, subjective quality.
•Excellent cross-functional leadership across engineering, AI teams, linguists, design, and external partners across multiple markets/languages.

Experience:5+ yearsLocalizationAI translation workflowsAI/MLEvaluation-driven productsCryptoFintech

Skills:Cross-functional leadershipDiagnostic thinkingProblem-solvingData fluency

Tech Stack:LLM evaluationGolden datasetsRLHFPromptingPrecision/recallAI/MLTranslation Management SystemsPhraseSmartlingICUCLDRContentfulWebflowFigma

Company Brief

OKX

Global cryptocurrency exchange and Web3 technology provider offering spot and derivatives trading, custody, wallet services, and blockchain infrastructure to retail and institutional users worldwide.

Industry: Trading Platforms

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: Victoria, Seychelles

Founded: 2017

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

OKX