Technical AI Policy Researcher, Frontier Risk - Trust and Safety

TikTok
San Francisco
Workplace: OnsiteFull timeFunction: Research & Scientific (R&D)Experience: 5+ yearsEducation: mastersSkills: ["Policy acumen","Judgment","Creativity","Analytical rigor","Stakeholder communication"]

Drive responsible development of frontier generative AI by designing and maintaining multimodal AI safety and fairness policy frameworks. Translate risk models into behavioral specifications, evaluation criteria, and safeguards, and build end-to-end pre- and post-launch evaluation workflows. Use red-teaming and deployment signals to improve policy quality over time, identify emerging frontier risks, and support AI compliance efforts with regulatory teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Technical AI Policy Researcher, Frontier Risk - Trust and Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 19 hours agoStatus: Live

Job Summary

Drive responsible development of frontier generative AI by designing and maintaining multimodal AI safety and fairness policy frameworks. Translate risk models into behavioral specifications, evaluation criteria, and safeguards, and build end-to-end pre- and post-launch evaluation workflows. Use red-teaming and deployment signals to improve policy quality over time, identify emerging frontier risks, and support AI compliance efforts with regulatory teams.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Research & Scientific (R&D)
Seniority: Mid level

Key Responsibilities

  • •Design and maintain multimodal GenAI policies across safety-relevant domains, including frontier risk in agentic modalities.
  • •Translate risk and harm models into behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
  • •Build end-to-end policy for pre-launch evaluation and post-launch monitoring, including golden sets, labeling guidance, calibration, adjudication, and eval coverage analysis.
  • •Improve policy and evaluation quality using red-teaming results, deployment data, model failures, over-refusals/under-refusals, and ambiguous edge cases.
  • •Contribute to risk reports, policy documentation, launch reviews, and AI governance reviews, and support regulatory teams as an AI compliance subject matter expert.

Key Requirements

  • •5+ years in Trust & Safety, AI Safety Research, AI Ethics, technical AI Governance, or equivalent experience.
  • •Advanced degree in Computer Science, Human-Computer Interaction, Engineering, Data Science, or quantitative Social Sciences.
  • •Direct experience in frontier risk research, AI evaluations, red-teaming, or AI governance work.
  • •Strong technical understanding of LLM, multimodal/genmedia model behavior, model failure modes, and safety risks.
  • •Demonstrated experience working with external experts and stakeholders (e.g., civil society, government, academia).
Experience:5+ yearsAI safety researchTrust & SafetyAI governanceRed-teaming
Education:Master's in Computer Science, Human-Computer Interaction, Engineering, Data Science or quantitative Social Sciences
Skills:Policy acumenJudgmentCreativityAnalytical rigorStakeholder communication
Tech Stack:LLMMultimodalGenmediaAgentic modalitiesRAGV&VModel risk assessmentsRed-teaming

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn