Content Quality and Evaluation Specialist (Korean Speaking) - Safety Model Operations

TikTok
Kuala Lumpur
Workplace: OnsiteFull timeFunction: Content & Editorial (Writing/Editing)Skills: ["Logical reasoning","Synthesis","Attention to detail","Cross-cultural communication","Ownership"]

Own quality assurance and evaluation for TikTok Trust & Safety machine learning systems. Build and iterate golden sets for ground-truth content safety data, perform deep-dive analyses on high-risk safety cases, and translate policies into executable SOPs. Drive a closed-loop process with cross-functional teams to spot vulnerabilities via golden set metrics and improve both human review quality and AI agent interception efficacy. Establish daily QA mechanisms and data-driven methodologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 day ago

Content Quality and Evaluation Specialist (Korean Speaking) - Safety Model Operations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live
Reposted: similar role first listed 2 weeks ago

Job Summary

Own quality assurance and evaluation for TikTok Trust & Safety machine learning systems. Build and iterate golden sets for ground-truth content safety data, perform deep-dive analyses on high-risk safety cases, and translate policies into executable SOPs. Drive a closed-loop process with cross-functional teams to spot vulnerabilities via golden set metrics and improve both human review quality and AI agent interception efficacy. Establish daily QA mechanisms and data-driven methodologies.
Location: Kuala Lumpur
Workplace: Onsite
Employment Type: Full time
Job Function: Content & Editorial (Writing/Editing)
Seniority: Mid level

Key Responsibilities

  • •Construct and iterate core Golden Sets by curating long-tail, high-risk, complex edge cases to establish ground truth standards for safety policies and AI model evaluation.
  • •Conduct deep-dive analyses on high-risk, debated safety cases to identify misapplication patterns and risk evolution trends, and synthesize rules into executable SOPs and operational guidelines.
  • •Drive a content safety data closed-loop by collaborating with Operations, Algorithm, Product, and global teams to identify system vulnerabilities and improve human review quality and AI agent interception efficacy.
  • •Systematize universal methodologies for content quality management and establish robust daily QA mechanisms.
  • •Monitor and track core data metrics, ensuring data accuracy and operational efficiency across projects.

Key Requirements

  • •Proven experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
  • •Exceptional logical reasoning and synthesis skills to identify root causes in complex, ambiguous scenarios and deliver structured solutions.
  • •Professional working proficiency in English, with extreme attention to detail and consistent standards.
  • •Korean proficiency is required for daily liaison with the local Korea team and accurate communication.
  • •Highly self-motivated with strong ownership, able to work in a fast-paced, cross-border environment and manage multiple parallel tasks.
Experience:Trust & safetyQuality assuranceAI data evaluationPolicy operationsMachine learning
Skills:Logical reasoningSynthesisAttention to detailCross-cultural communicationOwnership
Languages:EnglishKorean
Tech Stack:Machine learning modelsTrust & SafetyGolden SetsGround truthRCAKPIStandard Operating Procedures (SOPs)Quality assurance (QA)AI model evaluationData labeling

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn