Staff Applied AI Scientist

Wati
Shenzhen
Workplace: OnsiteFull timeFunction: Research & Scientific (R&D)Skills: ["Ownership","Product sense","Cross-functional communication"]

Lead the quality, performance, and optimization of production AI systems that power real customer conversations. Own the next phase of preference learning and fine-tuning, including evals, benchmarking, prompt optimization, failure analysis, and distillation. Define quality metrics across accuracy, instruction following, tool-use reliability, latency, multilingual performance, and cost efficiency. Build repeatable evaluation and feedback loops in partnership with product and engineering to improve outcomes at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Wati
Wati
4 months ago

Staff Applied AI Scientist

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Lead the quality, performance, and optimization of production AI systems that power real customer conversations. Own the next phase of preference learning and fine-tuning, including evals, benchmarking, prompt optimization, failure analysis, and distillation. Define quality metrics across accuracy, instruction following, tool-use reliability, latency, multilingual performance, and cost efficiency. Build repeatable evaluation and feedback loops in partnership with product and engineering to improve outcomes at scale.
Location: Shenzhen
Workplace: Onsite
Employment Type: Full time
Job Function: Research & Scientific (R&D)
Seniority: Mid level

Key Responsibilities

  • •Drive the next phase of preference learning and fine-tuning pipelines using production conversation data.
  • •Lead strategy for AI quality, evals, and benchmarking across production.
  • •Define and improve production AI performance metrics including accuracy, instruction following, tool-use reliability, latency, multilingual performance, and cost efficiency.
  • •Build repeatable evaluation and feedback loops to improve quality over time.
  • •Drive prompt optimization, failure analysis, model selection, and roadmap for distillation and longer-term model optimization.

Key Requirements

  • •Deep experience in LLMs, NLP, deep learning, or applied AI.
  • •Strong track record in evals and benchmarking, prompt engineering, fine-tuning, distillation, conversational AI/agent systems, or model optimization in production.
  • •Hands-on experience with preference learning, RLHF, or DPO pipelines is a strong plus.
  • •Experience improving production AI systems where quality, latency, and cost all matter.
  • •Strong ownership, product sense, and cross-functional communication skills; comfortable operating without a large team.
Experience:Applied AILLMsNLPDeep learningConversational AIAgent systemsProduction AI
Skills:OwnershipProduct senseCross-functional communication
Tech Stack:LLMsNLPDeep learningApplied AIPrompt engineeringFine-tuningDistillationConversational AIAgent systemsPreference learningRLHFDPOBenchmarkingEvalsReward modelLLM-as-judge

Company Brief

Wati
Provides a WhatsApp-based customer engagement platform that helps businesses manage sales, support, and marketing conversations in one shared inbox. The product includes automation, broadcasts, chatbots, and team collaboration tools for messaging-led workflows.
Industry: SaaS
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: Hong Kong, Hong Kong
Founded: 2018
WebsiteLinkedIn