16 hours ago

Senior Product Manager, Multilingual AI and Evals

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 10 hours agoStatus: Live

Job Summary

Own QA and evaluation for multilingual AI agents powering an AI-native localization stack. You’ll enhance the quality gate for auto-publishing translations, build AI-driven localization testing tools to catch issues like truncation and format errors, and create the evaluation/annotation infrastructure (golden datasets, error classification, metrics, feedback loops) that continuously improves agent performance at scale.

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Product Management

Seniority: Mid level

Key Responsibilities

•Enhance the quality gate of the agentic pipeline that decides whether translations are good enough to auto-publish.
•Diagnose systematic issues when the gate fails and drive fixes back into the agent.
•Build an AI-driven product testing tool to detect localization defects that review can’t catch (e.g., truncation, layout breakage, hardcoded strings, unlocalized images, wrong formats).
•Ship an MVP that scans mobile/web apps for localization auditing and integrate localization tests into internal product testing infrastructure.
•Build evaluation and annotation infrastructure (golden datasets, error classification tooling, automated evaluation, metrics/dashboard, and human-to-agent feedback loops).

Pay and Benefits

Perks:Health InsuranceMeal AllowanceLearning Budget

Key Requirements

•Bachelor's degree or higher with 3+ years in product management.
•Hands-on experience building or evaluating AI agent systems (not just using AI tools).
•Platform-building experience turning fuzzy workflows into systems others rely on (e.g., CMS, testing infrastructure, internal tooling).
•Experience with AI agents, agent harnesses, and evals for subjective, hard-to-measure quality problems; ability to design eval harnesses and golden datasets.
•Multi-market shipping experience across multiple markets or languages, working cross-culturally with distributed teams.

Experience:3+ yearsAI agentsLocalizationMultilingualSaaS

Education:Bachelor's

Skills:Cross-functional leadership

Languages:English

Tech Stack:AI-native localization stackPhraseSmartlingICUCLDR

Company Brief

OKX

Global cryptocurrency exchange and Web3 technology provider offering spot and derivatives trading, custody, wallet services, and blockchain infrastructure to retail and institutional users worldwide.

Industry: Trading Platforms

Company Size: Enterprise (1,001+ employees)

Growth: Established Company

Headquarters: Victoria, Seychelles

Founded: 2017

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

OKX