Senior Technical Product Manager - AI Agents, Evals & Reliability

BJAK
Jakarta
Workplace: RemoteFull timeFunction: Product ManagementSkills: ["Judgment","Decision-making","Prioritization","Communication","Collaboration"]

Own end-to-end strategy and product decisions for a proactive smart assistant, translating AI capabilities, data constraints, and evaluation results into reliable user behavior. Collaborate with ML, backend, and mobile engineers to define system requirements, make trade-offs across quality, latency, cost, and reliability, and evolve evaluation frameworks spanning offline metrics, online experiments, and human feedback. Drive fast, safe shipping with strong feedback loops and user trust.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
BJAK
BJAK
1 day ago

Senior Technical Product Manager - AI Agents, Evals & Reliability

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Own end-to-end strategy and product decisions for a proactive smart assistant, translating AI capabilities, data constraints, and evaluation results into reliable user behavior. Collaborate with ML, backend, and mobile engineers to define system requirements, make trade-offs across quality, latency, cost, and reliability, and evolve evaluation frameworks spanning offline metrics, online experiments, and human feedback. Drive fast, safe shipping with strong feedback loops and user trust.
Location: Jakarta
Workplace: Remote
Employment Type: Full time
Job Function: Product Management
Seniority: Mid level

Key Responsibilities

  • •Research and define end-to-end AI system requirements from capability to behavior and user impact.
  • •Translate model capabilities, data constraints, and evaluation results into product and system decisions.
  • •Make trade-offs across quality, latency, cost, reliability, and UX.
  • •Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
  • •Own product quality end-to-end, ensuring correctness, predictability, and user trust while driving safe, reliable shipping.

Key Requirements

  • •Strong computer science foundation, including algorithms, data structures, and system design.
  • •Solid understanding of ML fundamentals and how modern AI systems behave in production.
  • •Hands-on exposure to AI-powered products, including LLM-based systems, with experience working on model evaluation and feedback loops.
  • •Significant experience owning complex, technical products end-to-end and defining requirements in ambiguous environments.
  • •Comfort reading and discussing technical design documents, and ability to reason about hallucinations, bias, and drift.
Experience:AI-powered productsLLM-based systems
Skills:JudgmentDecision-makingPrioritizationCommunicationCollaboration
Tech Stack:MLLLM-based systemsSystem designModel evaluationOnline experimentsHuman feedback

Company Brief

BJAK
Bjak is a Malaysia-based insurtech that operates an online insurance comparison and distribution platform across SEA, simplifying purchase and servicing of motor and life insurance using digital tools and AI-enabled services.
Industry: InsurTech
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Selangor, Malaysia
Founded: 2019
Glassdoor
Glassdoor: 2.5
WebsiteLinkedInGlassdoor