TikTok LIVE - AI/ ML Data Operations Manager

TikTok
Singapore
Workplace: OnsiteFull timeFunction: Business OperationsExperience: 3+ yearsEducation: bachelorsSkills: ["Cross-functional collaboration","Process improvement","Quality governance","Problem solving","Stakeholder management"]

Own the end-to-end operating system for prompts, policy skills, and evaluation data powering TikTok LIVE multimodal LLM and agent moderation. Lead prompt engineering and data operations across video/image scenarios, design training/evaluation strategies, and translate policy expertise into executable prompts and agent skills. Partner with labeling and cross-functional teams to ensure quality governance, build tooling and multi-queue rollout mechanisms, and drive continuous improvement from production RCA.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
13 hours ago

TikTok LIVE - AI/ ML Data Operations Manager

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Own the end-to-end operating system for prompts, policy skills, and evaluation data powering TikTok LIVE multimodal LLM and agent moderation. Lead prompt engineering and data operations across video/image scenarios, design training/evaluation strategies, and translate policy expertise into executable prompts and agent skills. Partner with labeling and cross-functional teams to ensure quality governance, build tooling and multi-queue rollout mechanisms, and drive continuous improvement from production RCA.
Location: Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Business Operations
Seniority: Manager level

Key Responsibilities

  • •Lead prompt engineering and data operations, owning the full lifecycle of prompts, skills, and policy provisions across multimodal LLM agents for TikTok LIVE scenarios.
  • •Design training and evaluation data strategies, including sampling, golden-set/benchmark construction, blind-label protocols, offline/online evaluation packages, A/B measurement, and alternate evaluation designs.
  • •Align models with policies by converting policy provisions and expert judgment into executable prompts and agent skills, including standards and explainability/decision-structure requirements.
  • •Partner with labeling teams to deliver high-quality training/evaluation data through specifications, QC SOPs, ground-truth alignment, edge-case mining, SLAs, error analysis, and dataset refresh.
  • •Own evaluation, iteration, and rollout: diagnose metric movement and errors, prioritize remediation, prepare launch review evidence, and manage canary/A/B testing and cross-queue launches.

Key Requirements

  • •Bachelor’s degree or above.
  • •3+ years of experience in AI/ML data operations, prompt engineering, content-moderation strategy, annotation operations, technical program management, strategy, or related fields.
  • •Hands-on experience designing or operating prompts and LLM workflows for production systems, including training, evaluation, or online inference.
  • •Proven experience building evaluation frameworks (golden sets, benchmarks, labeling SOPs, QC, offline/online metrics, and experiment-ready packages) with a focus on process improvements.
  • •Strong experience working with labeling vendors or internal annotation teams, including taxonomy/specification design and quality control/delivery management.
Experience:3+ yearsAI/MLContent moderationPrompt engineeringTechnical program managementAnnotation operations
Education:Bachelor's
Skills:Cross-functional collaborationProcess improvementQuality governanceProblem solvingStakeholder management
Tech Stack:AIMLLLMAgent moderationPrompt engineeringJiraMeegoSQLPython

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn