ByteDance

2 days ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 1 hour agoStatus: Live

Job Summary

Build and deploy AI/ML analytics products that enable continuous internal auditing and automated risk discovery. Conduct model audits across the model lifecycle, measure performance and fairness, and assess LLM hallucination rates and stability. Partner with auditors to support audit engagements using data warehouses, ETL pipelines, and dashboards, and use machine learning to identify risk indicators and surface actionable insights at scale.

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Conduct model audits across the lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
•Identify model vulnerabilities (bias, fairness violations, harmful hallucinations, security risks) and recommend remediation strategies.
•Define and evaluate model performance and risk metrics, including LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
•Partner with auditors to provide data support for audit engagements, including interviews, query development/testing strategies, data quality checks, and insight derivation.
•Build and maintain data warehouses, ETL pipelines, and dashboards, and develop AI-driven automation for continuous auditing and risk-indicator analysis.

Key Requirements

•Bachelor’s degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
•5+ years of professional experience in applied data science, machine learning engineering, or AI research with LLMs and traditional ML models, plus practical data science/analytics experience from the technology sector.
•Hands-on experience designing, deploying, and monitoring large-scale ML models with strong proficiency in SQL and Python, including libraries such as Hugging Face Transformers, TensorFlow, PyTorch, and scikit-learn.
•Expertise defining and assessing model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness), including measuring LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
•Experience with transformer-based LLMs (e.g., GPT, BERT, T5, PaLM) and classical ML algorithms, with a track record supporting or performing AI/ML model audits or evaluations in a corporate, regulatory, or advisory context.

Experience:LLMsMachine learningAI researchB2C SaaSMedia techEcommerceSocial media platformsFintech

Education:Bachelor's in quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)

Skills:CommunicationCollaborationStakeholder managementRisk assessmentProblem-solving

Tech Stack:PythonSQLHugging Face TransformersTensorFlowPyTorchScikit-learnLLM auditingTransformer-based LLMsGPTBERTT5PaLMETLData warehousingDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

ByteDance

Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Beijing, China

Founded: 2012

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

ByteDance

2 days ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 1 hour agoStatus: Live

Job Summary

Location: Singapore

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Conduct model audits across the lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
•Identify model vulnerabilities (bias, fairness violations, harmful hallucinations, security risks) and recommend remediation strategies.
•Define and evaluate model performance and risk metrics, including LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
•Partner with auditors to provide data support for audit engagements, including interviews, query development/testing strategies, data quality checks, and insight derivation.
•Build and maintain data warehouses, ETL pipelines, and dashboards, and develop AI-driven automation for continuous auditing and risk-indicator analysis.

Key Requirements

•Bachelor’s degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
•5+ years of professional experience in applied data science, machine learning engineering, or AI research with LLMs and traditional ML models, plus practical data science/analytics experience from the technology sector.
•Hands-on experience designing, deploying, and monitoring large-scale ML models with strong proficiency in SQL and Python, including libraries such as Hugging Face Transformers, TensorFlow, PyTorch, and scikit-learn.
•Expertise defining and assessing model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness), including measuring LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
•Experience with transformer-based LLMs (e.g., GPT, BERT, T5, PaLM) and classical ML algorithms, with a track record supporting or performing AI/ML model audits or evaluations in a corporate, regulatory, or advisory context.

Experience:LLMsMachine learningAI researchB2C SaaSMedia techEcommerceSocial media platformsFintech

Education:Bachelor's in quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)

Skills:CommunicationCollaborationStakeholder managementRisk assessmentProblem-solving

Tech Stack:PythonSQLHugging Face TransformersTensorFlowPyTorchScikit-learnLLM auditingTransformer-based LLMsGPTBERTT5PaLMETLData warehousingDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

ByteDance

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Beijing, China

Founded: 2012

Website LinkedIn