Senior Data Scientist, Model Risk & Data Analytics, Internal Audit

ByteDance
Singapore
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningEducation: bachelorsSkills: ["Communication","Collaboration","Stakeholder management","Risk assessment","Problem-solving"]

Build and deploy AI/ML analytics products that enable continuous internal auditing and automated risk discovery. Conduct model audits across the model lifecycle, measure performance and fairness, and assess LLM hallucination rates and stability. Partner with auditors to support audit engagements using data warehouses, ETL pipelines, and dashboards, and use machine learning to identify risk indicators and surface actionable insights at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Senior Data Scientist, Model Risk & Data Analytics, Internal Audit

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 29 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and deploy AI/ML analytics products that enable continuous internal auditing and automated risk discovery. Conduct model audits across the model lifecycle, measure performance and fairness, and assess LLM hallucination rates and stability. Partner with auditors to support audit engagements using data warehouses, ETL pipelines, and dashboards, and use machine learning to identify risk indicators and surface actionable insights at scale.
Location: Singapore
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Conduct model audits across the lifecycle from training through deployment and monitoring, ensuring compliance with quality, performance, fairness, and risk-management standards.
  • •Identify model vulnerabilities (bias, fairness violations, harmful hallucinations, security risks) and recommend remediation strategies.
  • •Define and evaluate model performance and risk metrics, including LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
  • •Partner with auditors to provide data support for audit engagements, including interviews, query development/testing strategies, data quality checks, and insight derivation.
  • •Build and maintain data warehouses, ETL pipelines, and dashboards, and develop AI-driven automation for continuous auditing and risk-indicator analysis.

Key Requirements

  • •Bachelor’s degree in a quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics).
  • •5+ years of professional experience in applied data science, machine learning engineering, or AI research with LLMs and traditional ML models, plus practical data science/analytics experience from the technology sector.
  • •Hands-on experience designing, deploying, and monitoring large-scale ML models with strong proficiency in SQL and Python, including libraries such as Hugging Face Transformers, TensorFlow, PyTorch, and scikit-learn.
  • •Expertise defining and assessing model performance metrics (accuracy, precision/recall, F1, calibration, robustness, fairness), including measuring LLM hallucination rates, bias/fairness quantification, confidence scoring, and stability analyses.
  • •Experience with transformer-based LLMs (e.g., GPT, BERT, T5, PaLM) and classical ML algorithms, with a track record supporting or performing AI/ML model audits or evaluations in a corporate, regulatory, or advisory context.
Experience:LLMsMachine learningAI researchB2C SaaSMedia techEcommerceSocial media platformsFintech
Education:Bachelor's in quantitative discipline (e.g., Mathematics, Statistics, Computer Science, Financial Engineering, Operations Research, or Economics)
Skills:CommunicationCollaborationStakeholder managementRisk assessmentProblem-solving
Tech Stack:PythonSQLHugging Face TransformersTensorFlowPyTorchScikit-learnLLM auditingTransformer-based LLMsGPTBERTT5PaLMETLData warehousingDashboardsAWSGCPAzureSnowflakeHadoop

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn