Content Quality and Evaluation Specialist (Mandarin Speaking) - Safety Model Operations

TikTok
Kuala Lumpur
Full timeFunction: Content & Editorial (Writing/Editing)Skills: ["Logical reasoning","Synthesis","Attention to detail","Cross-cultural communication","Ownership"]

Build and continuously improve Golden Sets and ground-truth data standards for TikTok’s content safety ecosystem. Perform deep-dive investigations and root-cause analyses on high-risk safety cases, translating macro policies into executable SOPs and operational guidelines. Drive a closed-loop between Golden Set metrics and cross-functional partners to strengthen human review quality and AI interception efficacy, while systematizing QA methodologies and tracking core accuracy metrics.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Content Quality and Evaluation Specialist (Mandarin Speaking) - Safety Model Operations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Build and continuously improve Golden Sets and ground-truth data standards for TikTok’s content safety ecosystem. Perform deep-dive investigations and root-cause analyses on high-risk safety cases, translating macro policies into executable SOPs and operational guidelines. Drive a closed-loop between Golden Set metrics and cross-functional partners to strengthen human review quality and AI interception efficacy, while systematizing QA methodologies and tracking core accuracy metrics.
Location: Kuala Lumpur
Employment Type: Full time
Job Function: Content & Editorial (Writing/Editing)

Key Responsibilities

  • •Construct and iterate Golden Sets to create accurate ground-truth data standards for platform safety policies, AI evaluation, and enforcement.
  • •Conduct deep-dive analyses on high-risk and debated safety cases to identify misapplication patterns and risk evolution trends.
  • •Synthesize and abstract complex rules into logical, executable SOPs and operational guidelines.
  • •Drive closed-loop improvements by collaborating cross-functionally to identify vulnerabilities from Golden Set metrics and improve review quality and AI interception efficacy.
  • •Systematize content quality management methodologies and establish robust daily QA mechanisms to track and attribute key data accuracy metrics.

Key Requirements

  • •Proven experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
  • •Exceptional logical reasoning and synthesis to identify root causes in complex, ambiguous scenarios and deliver structured solutions.
  • •Professional working proficiency in English with extreme attention to detail and consistent standards.
  • •Strong cross-cultural written and verbal communication skills to support liaison and accurate information exchange.
  • •Mandarin proficiency is required for daily liaison with the China team.
Experience:Trust & safetyAI data evaluationPolicy operations
Skills:Logical reasoningSynthesisAttention to detailCross-cultural communicationOwnership
Languages:EnglishMandarin
Tech Stack:Machine learningAI modelsData labelingGolden SetsQuality assurance (QA)Root cause analysis (RCA)SOPsData metrics

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn