9 hours ago

Lead/Tech Expert - Global Live (LLM Model Serving)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 9 hours agoStatus: Live

Job Summary

Design and deploy large-scale LLM model serving systems for TikTok Live’s real-time architecture. Own conversion of deep learning models into scalable production services, optimizing inference performance to reduce latency and increase throughput. Collaborate with algorithm and business teams to ship and troubleshoot production deployments, and continuously explore new AI methods and technologies to advance model services.

Location: Singapore

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Mid level

Key Responsibilities

•Convert large-scale deep learning models into scalable model serving services for TikTok Live.
•Optimize model inference performance by efficiently using computing resources, minimizing response time, and maximizing throughput.
•Collaborate with algorithm and business teams to deploy models into production and resolve production issues.
•Monitor and explore new AI technologies and methods to drive technical advancement in model services.

Key Requirements

•Bachelor’s degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
•3+ years of relevant experience deploying and servicing large-scale machine learning models.
•Proficiency in deep learning frameworks such as TensorFlow, PyTorch, and DeepSpeed in production environments.
•Experience with model inference optimization techniques (e.g., quantization, distillation, distributed inference, ONNX, ZeRO).
•Strong programming skills in Python, C++, or Golang, with deep understanding of system performance optimization.

Experience:3+ yearsMachine learningLLMLive streaming

Education:Bachelor's

Skills:Cross-team collaborationTechnical innovationSystem performance optimizationProblem solvingContinuous improvement

Tech Stack:PythonC++GolangTensorFlowPyTorchDeepSpeedONNXZeROQuantizationDistillationDistributed inferenceRPCRedisKafka

Company Brief

TikTok

Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

TikTok

9 hours ago

Lead/Tech Expert - Global Live (LLM Model Serving)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 9 hours agoStatus: Live

Job Summary

Location: Singapore

Employment Type: Full time

Job Function: Administration & Executive Assistance

Seniority: Mid level

Key Responsibilities

•Convert large-scale deep learning models into scalable model serving services for TikTok Live.
•Optimize model inference performance by efficiently using computing resources, minimizing response time, and maximizing throughput.
•Collaborate with algorithm and business teams to deploy models into production and resolve production issues.
•Monitor and explore new AI technologies and methods to drive technical advancement in model services.

Key Requirements

•Bachelor’s degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
•3+ years of relevant experience deploying and servicing large-scale machine learning models.
•Proficiency in deep learning frameworks such as TensorFlow, PyTorch, and DeepSpeed in production environments.
•Experience with model inference optimization techniques (e.g., quantization, distillation, distributed inference, ONNX, ZeRO).
•Strong programming skills in Python, C++, or Golang, with deep understanding of system performance optimization.

Experience:3+ yearsMachine learningLLMLive streaming

Education:Bachelor's

Skills:Cross-team collaborationTechnical innovationSystem performance optimizationProblem solvingContinuous improvement

Tech Stack:PythonC++GolangTensorFlowPyTorchDeepSpeedONNXZeROQuantizationDistillationDistributed inferenceRPCRedisKafka

Company Brief

TikTok

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Growth: Scaleup

Headquarters: Singapore, Singapore

Founded: 2016

Website LinkedIn