Senior Technical Product Manager - AI Agents, Evals & Reliability

BJAK
Beijing
Workplace: RemoteFull timeFunction: Product ManagementSkills: ["Strong judgment","Decision-making","Disciplined prioritization","Independent execution","Technical communication"]

Own end-to-end requirements and product decisions for a proactive AI assistant focused on reliable, long-running workflows. Translate model capabilities, data constraints, and evaluation results into system and product trade-offs across quality, latency, cost, reliability, and UX. Define evaluation frameworks (offline, online, human feedback), partner with ML, backend, and mobile engineers, and ensure correctness, predictability, and user trust through tight feedback loops.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
BJAK
BJAK
2 days ago

Senior Technical Product Manager - AI Agents, Evals & Reliability

âś“ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Own end-to-end requirements and product decisions for a proactive AI assistant focused on reliable, long-running workflows. Translate model capabilities, data constraints, and evaluation results into system and product trade-offs across quality, latency, cost, reliability, and UX. Define evaluation frameworks (offline, online, human feedback), partner with ML, backend, and mobile engineers, and ensure correctness, predictability, and user trust through tight feedback loops.
Location: Beijing
Workplace: Remote
Employment Type: Full time
Job Function: Product Management
Seniority: Mid level

Key Responsibilities

  • •Research and define end-to-end AI system requirements from capability through user impact.
  • •Translate model capabilities, data constraints, and evaluation results into clear product and system decisions.
  • •Make hard trade-offs across quality, latency, cost, reliability, and UX.
  • •Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
  • •Own product quality end-to-end—correctness, predictability, and user trust—using strong feedback loops.

Key Requirements

  • •Strong CS fundamentals including algorithms, data structures, and system design.
  • •Solid understanding of ML fundamentals and how modern AI systems behave in production.
  • •Hands-on exposure to AI-powered products, including LLM-based systems, with experience in model evaluation and iteration.
  • •Comfort reviewing and discussing technical design documents and system requirements.
  • •Significant experience owning complex, technical products end-to-end with strong judgment in ambiguous, fast-moving environments.
Experience:AI-powered productsLLM-based systemsML systemsAI agentsConsumer products
Skills:Strong judgmentDecision-makingDisciplined prioritizationIndependent executionTechnical communication
Tech Stack:LLM-based systemsMachine learningAI agentsEvaluation frameworks

Company Brief

BJAK
Bjak is a Malaysia-based insurtech that operates an online insurance comparison and distribution platform across SEA, simplifying purchase and servicing of motor and life insurance using digital tools and AI-enabled services.
Industry: InsurTech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Selangor, Malaysia
Founded: 2019
Glassdoor
Glassdoor: 2.5
WebsiteLinkedInGlassdoor