Senior Technical Product Manager - AI Agents, Evals & Reliability

BJAK
Singapore
Workplace: RemoteFull timeFunction: Product ManagementSkills: ["Judgment","Decision-making","Prioritization","Execution","Collaboration"]

Own end-to-end requirements and product/system decisions for an AI assistant that delivers reliable, real-world task completion. Translate model capabilities, data constraints, and evaluation results into clear roadmaps, specs, and trade-offs across quality, latency, cost, reliability, and UX. Define evaluation frameworks spanning offline metrics, online experiments, and human feedback, partnering with ML, backend, and mobile engineers to ship safely and quickly.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
BJAK
BJAK
1 day ago

Senior Technical Product Manager - AI Agents, Evals & Reliability

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Own end-to-end requirements and product/system decisions for an AI assistant that delivers reliable, real-world task completion. Translate model capabilities, data constraints, and evaluation results into clear roadmaps, specs, and trade-offs across quality, latency, cost, reliability, and UX. Define evaluation frameworks spanning offline metrics, online experiments, and human feedback, partnering with ML, backend, and mobile engineers to ship safely and quickly.
Location: Singapore
Workplace: Remote
Employment Type: Full time
Job Function: Product Management
Seniority: Mid level

Key Responsibilities

  • •Research and define end-to-end AI system requirements from capability to behavior and user impact.
  • •Translate model capabilities, data constraints, and evaluation results into product and system decisions.
  • •Make trade-offs across quality, latency, cost, reliability, and UX.
  • •Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
  • •Drive execution by writing clear specs, ensuring safe and reliable shipping with strong feedback loops.

Key Requirements

  • •Strong computer science fundamentals, including algorithms, data structures, and system design.
  • •Solid understanding of ML fundamentals and how modern AI systems behave in production.
  • •Hands-on exposure to AI-powered products, including LLM-based systems, with experience in model evaluation and feedback loops.
  • •Significant experience owning complex, technical products end-to-end and making decisions in ambiguous, fast-moving environments.
  • •Comfort reading and discussing technical design documents and working closely with senior engineers and ML teams.
Experience:AILLM
Skills:JudgmentDecision-makingPrioritizationExecutionCollaboration
Tech Stack:LLM-based systems

Company Brief

BJAK
Bjak is a Malaysia-based insurtech that operates an online insurance comparison and distribution platform across SEA, simplifying purchase and servicing of motor and life insurance using digital tools and AI-enabled services.
Industry: InsurTech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Selangor, Malaysia
Founded: 2019
Glassdoor
Glassdoor: 2.5
WebsiteLinkedInGlassdoor