2 days ago

Technical AI Policy Researcher, Model Behaviour - Trust and Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 8 hours agoStatus: Live

Job Summary

Shape responsible-development policies for frontier GenAI models by translating safety and fairness risks into measurable evaluation criteria, behavioral specifications, and deployment safeguards. Lead end-to-end policy workflows from pre-launch assessment to post-launch monitoring, using red-teaming and model telemetry to improve coverage and reduce over/under-refusals. Partner with safety researchers, engineering, product, and regulatory stakeholders to operationalize policy and strengthen AI governance.

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Mid level

Key Responsibilities

•Design and maintain multimodal GenAI policies across safety-relevant domains, including political/ideological bias, deceptive misuse, manipulation/persuasion, and fairness.
•Translate risk and harm models into behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
•Define practical boundaries for beneficial AI uses versus assistance that could materially enable harm, exploitation, misuse, or unsafe outcomes.
•Build policy artifacts to support model training, evaluation, and deployment, partnering with research, engineering, and product stakeholders to operationalize policy.
•Develop end-to-end workflows from pre-launch evaluation to post-launch monitoring (e.g., golden set construction, labeling guidance, calibration, adjudication, and eval coverage analysis) to ensure policies can be reliably measured and improved.

Key Requirements

•5+ years in Trust & Safety, AI Safety Research, AI Ethics, technical AI Governance, or equivalent experience.
•A degree in Computer Science, Human-Computer Interaction, Engineering, Data Science, or quantitative Social Sciences.
•Direct experience in policy development, AI evaluations, red-teaming, or AI governance work.
•Strong technical understanding of LLMs, multimodel/generative media model behavior, model failure modes, and safety risks.
•Demonstrated experience working with external experts and stakeholders (civil society, government, academia).

Experience:5+ yearsAI safety researchTrust & SafetyAI governanceRed-teamingLLMGenAI

Education:Bachelor's in Computer Science, Human-Computer Interaction, Engineering, Data Science or quantitative Social Sciences

Skills:Policy acumenJudgmentCreativityAnalytical rigorStakeholder communication

Tech Stack:PythonLLMMultimodal GenAIMultimodelGenerative media modelsModel risk assessments

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

2 days ago

Technical AI Policy Researcher, Model Behaviour - Trust and Safety

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 8 hours agoStatus: Live

Job Summary

Location: San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: Research & Scientific (R&D)

Seniority: Mid level

Key Responsibilities

•Design and maintain multimodal GenAI policies across safety-relevant domains, including political/ideological bias, deceptive misuse, manipulation/persuasion, and fairness.
•Translate risk and harm models into behavioral specifications, evaluation criteria, grading guidance, and system-level safeguards.
•Define practical boundaries for beneficial AI uses versus assistance that could materially enable harm, exploitation, misuse, or unsafe outcomes.
•Build policy artifacts to support model training, evaluation, and deployment, partnering with research, engineering, and product stakeholders to operationalize policy.
•Develop end-to-end workflows from pre-launch evaluation to post-launch monitoring (e.g., golden set construction, labeling guidance, calibration, adjudication, and eval coverage analysis) to ensure policies can be reliably measured and improved.

Key Requirements

•5+ years in Trust & Safety, AI Safety Research, AI Ethics, technical AI Governance, or equivalent experience.
•A degree in Computer Science, Human-Computer Interaction, Engineering, Data Science, or quantitative Social Sciences.
•Direct experience in policy development, AI evaluations, red-teaming, or AI governance work.
•Strong technical understanding of LLMs, multimodel/generative media model behavior, model failure modes, and safety risks.
•Demonstrated experience working with external experts and stakeholders (civil society, government, academia).

Experience:5+ yearsAI safety researchTrust & SafetyAI governanceRed-teamingLLMGenAI

Education:Bachelor's in Computer Science, Human-Computer Interaction, Engineering, Data Science or quantitative Social Sciences

Skills:Policy acumenJudgmentCreativityAnalytical rigorStakeholder communication

Tech Stack:PythonLLMMultimodal GenAIMultimodelGenerative media modelsModel risk assessments

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn