1 day ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit - AMS

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 1 hour agoStatus: Live

Job Summary

Build state-of-the-art analytics products that enable continuous auditing by applying data science and AI to evaluate model lifecycle risk. You will audit ML/LLM models for performance, fairness, robustness, interpretability, alignment, and compliance; quantify hallucination and bias; and recommend remediation. Partner with auditors to deliver data support, ETL pipelines, data quality checks, dashboards, and automation strategies that scale actionable audit insights.

Location: San Jose

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Audit model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
•Identify and mitigate model vulnerabilities such as bias/fairness violations, harmful hallucinations, and security risks, and recommend remediation strategies.
•Define and assess model performance and statistical validation measures (accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, stability analyses).
•Partner with auditors by providing data support, including developing queries/testing strategies and deploying data quality checks for completeness and accuracy.
•Build and maintain data warehouses and automation for continuous auditing, including ETL pipelines, dashboards, and AI-driven insights from structured and unstructured data.

Key Requirements

•Bachelor's degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
•5+ years of applied data science, machine learning engineering, or AI research working with LLMs and traditional ML models.
•Hands-on experience designing, deploying, and monitoring large-scale ML models with strong SQL and Python skills and ML libraries (Hugging Face Transformers, TensorFlow, PyTorch, scikit-learn).
•Expertise defining and assessing model performance and risk metrics, including accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, and stability analyses.
•Extensive knowledge of transformer-based LLM architectures and classical ML algorithms, plus proven experience conducting or supporting AI/ML model audits in a corporate/regulatory/advisory context.

Experience:5+ yearsLLMsMachine learningAI researchTechnology sectorFintechMedia techE-commerceSocial media platformsB2C SaaS

Education:Bachelor's in quantitative discipline (Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)

Skills:CommunicationCollaborationStakeholder managementRisk assessmentAnalysis

Tech Stack:SQLPythonHugging Face TransformersTensorFlowPyTorchScikit-learnLLMsTransformer-based modelsGPTBERTT5PaLMETLData pipelinesDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

1 day ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit - AMS

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 1 hour agoStatus: Live

Job Summary

Location: San Jose

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Audit model lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
•Identify and mitigate model vulnerabilities such as bias/fairness violations, harmful hallucinations, and security risks, and recommend remediation strategies.
•Define and assess model performance and statistical validation measures (accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, stability analyses).
•Partner with auditors by providing data support, including developing queries/testing strategies and deploying data quality checks for completeness and accuracy.
•Build and maintain data warehouses and automation for continuous auditing, including ETL pipelines, dashboards, and AI-driven insights from structured and unstructured data.

Key Requirements

•Bachelor's degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
•5+ years of applied data science, machine learning engineering, or AI research working with LLMs and traditional ML models.
•Hands-on experience designing, deploying, and monitoring large-scale ML models with strong SQL and Python skills and ML libraries (Hugging Face Transformers, TensorFlow, PyTorch, scikit-learn).
•Expertise defining and assessing model performance and risk metrics, including accuracy, precision/recall, F1, calibration, robustness, fairness metrics, confidence scoring, and stability analyses.
•Extensive knowledge of transformer-based LLM architectures and classical ML algorithms, plus proven experience conducting or supporting AI/ML model audits in a corporate/regulatory/advisory context.

Experience:5+ yearsLLMsMachine learningAI researchTechnology sectorFintechMedia techE-commerceSocial media platformsB2C SaaS

Education:Bachelor's in quantitative discipline (Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)

Skills:CommunicationCollaborationStakeholder managementRisk assessmentAnalysis

Tech Stack:SQLPythonHugging Face TransformersTensorFlowPyTorchScikit-learnLLMsTransformer-based modelsGPTBERTT5PaLMETLData pipelinesDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn