Content Quality and Evaluation Specialist - Safety Model Operations

TikTok
Kuala Lumpur
Workplace: OnsiteFull timeFunction: Content & Editorial (Writing/Editing)Education: bachelorsSkills: ["Logical reasoning","Synthesis","Attention to detail","Standard consistency","Cross-cultural communication","Ownership","Cross-functional collaboration"]

Own quality assurance and evaluation for Trust & Safety machine learning models. Build and iterate Golden Sets (ground truth) for content safety, run deep-dive analyses on high-risk cases, and translate macro policies into executable SOPs. Drive a closed-loop process with cross-functional teams to detect vulnerabilities via Golden Set metrics and improve both human review and AI agent interception effectiveness, while systematizing daily QA mechanisms and data accuracy.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Content Quality and Evaluation Specialist - Safety Model Operations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Own quality assurance and evaluation for Trust & Safety machine learning models. Build and iterate Golden Sets (ground truth) for content safety, run deep-dive analyses on high-risk cases, and translate macro policies into executable SOPs. Drive a closed-loop process with cross-functional teams to detect vulnerabilities via Golden Set metrics and improve both human review and AI agent interception effectiveness, while systematizing daily QA mechanisms and data accuracy.
Location: Kuala Lumpur
Workplace: Onsite
Employment Type: Full time
Job Function: Content & Editorial (Writing/Editing)

Key Responsibilities

  • •Construct and iterate core Golden Sets for the content safety ecosystem, curating high-risk edge cases to define accurate ground truth data standards.
  • •Perform deep-dive analyses on high-risk, debated safety cases to identify misapplication patterns and evolving risk trends, and synthesize rules into executable SOPs.
  • •Drive a closed-loop content safety data process by collaborating with Operations, Algorithm, Product, and global teams to identify vulnerabilities from Golden Set metrics.
  • •Systematize a content quality management framework and establish robust daily QA mechanisms to track and attribute core data metrics for improved accuracy and efficiency.
  • •Provide structured feedback and improvement recommendations to the Central Project Team and support continual workflow/tool/evaluation methodology optimization.

Key Requirements

  • •Bachelor’s degree or above with preferred experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
  • •Exceptional logical reasoning and synthesis, with the ability to identify root causes in complex, ambiguous scenarios and deliver structured solutions.
  • •Professional working proficiency in English, with extreme attention to detail and strong cross-cultural written and verbal communication.
  • •Highly self-motivated and able to embrace uncertainty in a fast-paced, cross-border environment while driving multiple parallel tasks.
  • •Strong plus: familiarity with machine learning logic and data labeling frameworks.
Experience:Internet Trust & SafetyQuality Assurance (QA)AI data evaluationPolicy operations
Education:Bachelor's
Skills:Logical reasoningSynthesisAttention to detailStandard consistencyCross-cultural communicationOwnershipCross-functional collaboration
Languages:English

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn