2 days ago

Content Quality and Evaluation Specialist - Safety Model Operations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 4 hours agoStatus: Live

Job Summary

Own quality assurance and evaluation for Trust & Safety machine learning models. Build and iterate Golden Sets (ground truth) for content safety, run deep-dive analyses on high-risk cases, and translate macro policies into executable SOPs. Drive a closed-loop process with cross-functional teams to detect vulnerabilities via Golden Set metrics and improve both human review and AI agent interception effectiveness, while systematizing daily QA mechanisms and data accuracy.

Location: Kuala Lumpur

Workplace: Onsite

Employment Type: Full time

Job Function: Content & Editorial (Writing/Editing)

Key Responsibilities

•Construct and iterate core Golden Sets for the content safety ecosystem, curating high-risk edge cases to define accurate ground truth data standards.
•Perform deep-dive analyses on high-risk, debated safety cases to identify misapplication patterns and evolving risk trends, and synthesize rules into executable SOPs.
•Drive a closed-loop content safety data process by collaborating with Operations, Algorithm, Product, and global teams to identify vulnerabilities from Golden Set metrics.
•Systematize a content quality management framework and establish robust daily QA mechanisms to track and attribute core data metrics for improved accuracy and efficiency.
•Provide structured feedback and improvement recommendations to the Central Project Team and support continual workflow/tool/evaluation methodology optimization.

Key Requirements

•Bachelor’s degree or above with preferred experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
•Exceptional logical reasoning and synthesis, with the ability to identify root causes in complex, ambiguous scenarios and deliver structured solutions.
•Professional working proficiency in English, with extreme attention to detail and strong cross-cultural written and verbal communication.
•Highly self-motivated and able to embrace uncertainty in a fast-paced, cross-border environment while driving multiple parallel tasks.
•Strong plus: familiarity with machine learning logic and data labeling frameworks.

Experience:Internet Trust & SafetyQuality Assurance (QA)AI data evaluationPolicy operations

Education:Bachelor's

Skills:Logical reasoningSynthesisAttention to detailStandard consistencyCross-cultural communicationOwnershipCross-functional collaboration

Languages:English

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

2 days ago

Content Quality and Evaluation Specialist - Safety Model Operations

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 4 hours agoStatus: Live

Job Summary

Location: Kuala Lumpur

Workplace: Onsite

Employment Type: Full time

Job Function: Content & Editorial (Writing/Editing)

Key Responsibilities

•Construct and iterate core Golden Sets for the content safety ecosystem, curating high-risk edge cases to define accurate ground truth data standards.
•Perform deep-dive analyses on high-risk, debated safety cases to identify misapplication patterns and evolving risk trends, and synthesize rules into executable SOPs.
•Drive a closed-loop content safety data process by collaborating with Operations, Algorithm, Product, and global teams to identify vulnerabilities from Golden Set metrics.
•Systematize a content quality management framework and establish robust daily QA mechanisms to track and attribute core data metrics for improved accuracy and efficiency.
•Provide structured feedback and improvement recommendations to the Central Project Team and support continual workflow/tool/evaluation methodology optimization.

Key Requirements

•Bachelor’s degree or above with preferred experience in internet Trust & Safety, Quality Assurance (QA), AI data evaluation, or policy operations.
•Exceptional logical reasoning and synthesis, with the ability to identify root causes in complex, ambiguous scenarios and deliver structured solutions.
•Professional working proficiency in English, with extreme attention to detail and strong cross-cultural written and verbal communication.
•Highly self-motivated and able to embrace uncertainty in a fast-paced, cross-border environment while driving multiple parallel tasks.
•Strong plus: familiarity with machine learning logic and data labeling frameworks.

Experience:Internet Trust & SafetyQuality Assurance (QA)AI data evaluationPolicy operations

Education:Bachelor's

Skills:Logical reasoningSynthesisAttention to detailStandard consistencyCross-cultural communicationOwnershipCross-functional collaboration

Languages:English

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn