Senior Data Scientist, Model Risk & Data Analytics, Internal Audit - AMS

TikTok
San Jose
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 5+ yearsEducation: bachelorsSkills: ["Communication","Collaboration","Stakeholder management","Risk assessment","Analysis"]

Build state-of-the-art analytics products that enable continuous auditing by applying data science and AI to evaluate model lifecycle risk. You will audit ML/LLM models for performance, fairness, robustness, interpretability, alignment, and compliance; quantify hallucination and bias; and recommend remediation. Partner with auditors to deliver data support, ETL pipelines, data quality checks, dashboards, and automation strategies that scale actionable audit insights.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit - AMS

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 20 hours agoStatus: Live

Job Summary

Build state-of-the-art analytics products that enable continuous auditing by applying data science and AI to evaluate model lifecycle risk. You will audit ML/LLM models for performance, fairness, robustness, interpretability, alignment, and compliance; quantify hallucination and bias; and recommend remediation. Partner with auditors to deliver data support, ETL pipelines, data quality checks, dashboards, and automation strategies that scale actionable audit insights.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Audit model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
  • •Identify and mitigate model vulnerabilities such as bias/fairness violations, harmful hallucinations, and security risks, and recommend remediation strategies.
  • •Define and assess model performance and statistical validation measures (accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, stability analyses).
  • •Partner with auditors by providing data support, including developing queries/testing strategies and deploying data quality checks for completeness and accuracy.
  • •Build and maintain data warehouses and automation for continuous auditing, including ETL pipelines, dashboards, and AI-driven insights from structured and unstructured data.

Key Requirements

  • •Bachelor's degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
  • •5+ years of applied data science, machine learning engineering, or AI research working with LLMs and traditional ML models.
  • •Hands-on experience designing, deploying, and monitoring large-scale ML models with strong SQL and Python skills and ML libraries (Hugging Face Transformers, TensorFlow, PyTorch, scikit-learn).
  • •Expertise defining and assessing model performance and risk metrics, including accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, and stability analyses.
  • •Extensive knowledge of transformer-based LLM architectures and classical ML algorithms, plus proven experience conducting or supporting AI/ML model audits in a corporate/regulatory/advisory context.
Experience:5+ yearsLLMsMachine learningAI researchTechnology sectorFintechMedia techE-commerceSocial media platformsB2C SaaS
Education:Bachelor's in quantitative discipline (Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)
Skills:CommunicationCollaborationStakeholder managementRisk assessmentAnalysis
Tech Stack:SQLPythonHugging Face TransformersTensorFlowPyTorchScikit-learnLLMsTransformer-based modelsGPTBERTT5PaLMETLData pipelinesDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn