2 days ago

Technical AI Policy Researcher, Frontier Risk - Trust and Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 8 hours agoStatus: Live

Job Summary

Drive responsible development of frontier generative AI by designing and maintaining multimodal AI safety and fairness policy frameworks. Translate risk models into behavioral specifications, evaluation criteria, and safeguards, and build end-to-end pre- and post-launch evaluation workflows. Use red-teaming and deployment signals to improve policy quality over time, identify emerging frontier risks, and support AI compliance efforts with regulatory teams.

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Mid level

Key Responsibilities

•Design and maintain multimodal GenAI policies across safety-relevant domains, including frontier risk in agentic modalities.
•Translate risk and harm models into behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
•Build end-to-end policy for pre-launch evaluation and post-launch monitoring, including golden sets, labeling guidance, calibration, adjudication, and eval coverage analysis.
•Improve policy and evaluation quality using red-teaming results, deployment data, model failures, over-refusals/under-refusals, and ambiguous edge cases.
•Contribute to risk reports, policy documentation, launch reviews, and AI governance reviews, and support regulatory teams as an AI compliance subject matter expert.

Key Requirements

•5+ years in Trust & Safety, AI Safety Research, AI Ethics, technical AI Governance, or equivalent experience.
•Advanced degree in Computer Science, Human-Computer Interaction, Engineering, Data Science, or quantitative Social Sciences.
•Direct experience in frontier risk research, AI evaluations, red-teaming, or AI governance work.
•Strong technical understanding of LLM, multimodal/genmedia model behavior, model failure modes, and safety risks.
•Demonstrated experience working with external experts and stakeholders (e.g., civil society, government, academia).

Experience:5+ yearsAI safety researchTrust & SafetyAI governanceRed-teaming

Education:Master's in Computer Science, Human-Computer Interaction, Engineering, Data Science or quantitative Social Sciences

Skills:Policy acumenJudgmentCreativityAnalytical rigorStakeholder communication

Tech Stack:LLMMultimodalGenmediaAgentic modalitiesRAGV&VModel risk assessmentsRed-teaming

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

2 days ago

Technical AI Policy Researcher, Frontier Risk - Trust and Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 8 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Mid level

Key Responsibilities

•Design and maintain multimodal GenAI policies across safety-relevant domains, including frontier risk in agentic modalities.
•Translate risk and harm models into behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
•Build end-to-end policy for pre-launch evaluation and post-launch monitoring, including golden sets, labeling guidance, calibration, adjudication, and eval coverage analysis.
•Improve policy and evaluation quality using red-teaming results, deployment data, model failures, over-refusals/under-refusals, and ambiguous edge cases.
•Contribute to risk reports, policy documentation, launch reviews, and AI governance reviews, and support regulatory teams as an AI compliance subject matter expert.

Key Requirements

•5+ years in Trust & Safety, AI Safety Research, AI Ethics, technical AI Governance, or equivalent experience.
•Advanced degree in Computer Science, Human-Computer Interaction, Engineering, Data Science, or quantitative Social Sciences.
•Direct experience in frontier risk research, AI evaluations, red-teaming, or AI governance work.
•Strong technical understanding of LLM, multimodal/genmedia model behavior, model failure modes, and safety risks.
•Demonstrated experience working with external experts and stakeholders (e.g., civil society, government, academia).

Experience:5+ yearsAI safety researchTrust & SafetyAI governanceRed-teaming

Education:Master's in Computer Science, Human-Computer Interaction, Engineering, Data Science or quantitative Social Sciences

Skills:Policy acumenJudgmentCreativityAnalytical rigorStakeholder communication

Tech Stack:LLMMultimodalGenmediaAgentic modalitiesRAGV&VModel risk assessmentsRed-teaming

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn