2 days ago

AI Model Metrics Project Lead - AI Data Service and Operations (Eco Governance)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 3 hours agoStatus: Live

Job Summary

Lead end-to-end delivery of AI data annotation projects within the Eco Governance team, directly managing a team of AI Project Managers. Design and run AI/LLM evaluation frameworks using safety-focused and adversarial test cases, then analyze model outputs with metrics like accuracy, safety, relevance, bias, and robustness. Translate findings into actionable recommendations, govern cross-functional reviews and escalations, and drive continuous improvements across labeling quality and model performance.

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Manager level

Key Responsibilities

•Lead end-to-end execution of multiple AI data annotation and model evaluation projects, meeting annotation SLAs and model performance benchmarks.
•Develop or refine AI model evaluation frameworks, including creating test cases/datasets (adversarial/safety-focused) and running evaluations on LLM outputs.
•Analyze evaluation results with deep dives and root cause analysis to identify failure patterns and recommend improvements across guidelines, data collection, fine-tuning, or processes.
•Serve as the primary interface between product, safety, and business needs and translate them into clear annotation + evaluation requirements and success metrics.
•Establish governance and cross-functional collaboration rhythms (reviews/escalations), monitor dashboards, and drive continuous improvements and risk mitigation.

Key Requirements

•Bachelor’s degree or above; majors in Data Science, Statistics, Mathematics, Computer Science, or related fields are preferred.
•5+ years of project/program management experience in AI data annotation, large-scale data operations, content moderation, or AI model evaluation environments.
•3+ years of hands-on experience in AI/LLM model evaluation, including designing evaluation methodologies and conducting root cause analysis on performance issues.
•3+ years of regional team management experience, leading a team of project managers (or similar roles).
•Strong spoken and written English with excellent stakeholder management and communication, presenting complex findings to regional/global teams.

Experience:5+ yearsAI data annotationLarge-scale data operationsContent moderationAI model evaluation

Education:Bachelor's in Data Science, Statistics, Mathematics, Computer Science (or related fields)

Skills:Stakeholder managementCommunicationRoot cause analysisData-driven decision makingContinuous improvement

Certifications:PMPAgileLean Six Sigma

Languages:English

Tech Stack:AILLMData labelingExcelSQLDashboards

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

2 days ago

AI Model Metrics Project Lead - AI Data Service and Operations (Eco Governance)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 3 hours agoStatus: Live

Job Summary

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Manager level

Key Responsibilities

•Lead end-to-end execution of multiple AI data annotation and model evaluation projects, meeting annotation SLAs and model performance benchmarks.
•Develop or refine AI model evaluation frameworks, including creating test cases/datasets (adversarial/safety-focused) and running evaluations on LLM outputs.
•Analyze evaluation results with deep dives and root cause analysis to identify failure patterns and recommend improvements across guidelines, data collection, fine-tuning, or processes.
•Serve as the primary interface between product, safety, and business needs and translate them into clear annotation + evaluation requirements and success metrics.
•Establish governance and cross-functional collaboration rhythms (reviews/escalations), monitor dashboards, and drive continuous improvements and risk mitigation.

Key Requirements

•Bachelor’s degree or above; majors in Data Science, Statistics, Mathematics, Computer Science, or related fields are preferred.
•5+ years of project/program management experience in AI data annotation, large-scale data operations, content moderation, or AI model evaluation environments.
•3+ years of hands-on experience in AI/LLM model evaluation, including designing evaluation methodologies and conducting root cause analysis on performance issues.
•3+ years of regional team management experience, leading a team of project managers (or similar roles).
•Strong spoken and written English with excellent stakeholder management and communication, presenting complex findings to regional/global teams.

Experience:5+ yearsAI data annotationLarge-scale data operationsContent moderationAI model evaluation

Education:Bachelor's in Data Science, Statistics, Mathematics, Computer Science (or related fields)

Skills:Stakeholder managementCommunicationRoot cause analysisData-driven decision makingContinuous improvement

Certifications:PMPAgileLean Six Sigma

Languages:English

Tech Stack:AILLMData labelingExcelSQLDashboards

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn