AI Application Infra - Technical Specialist/Engineer - TikTok LIVE

TikTok
Singapore
Full timeFunction: Administration & Executive AssistanceExperience: 3+ yearsEducation: bachelorsSkills: ["Cross-team collaboration","Technical innovation","System performance optimization","Problem solving","Continuous improvement"]

Design and deploy large-scale LLM model serving systems for TikTok Live’s real-time architecture. Own conversion of deep learning models into scalable production services, optimizing inference performance to reduce latency and increase throughput. Collaborate with algorithm and business teams to ship and troubleshoot production deployments, and continuously explore new AI methods and technologies to advance model services.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

AI Application Infra - Technical Specialist/Engineer - TikTok LIVE

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Design and deploy large-scale LLM model serving systems for TikTok Live’s real-time architecture. Own conversion of deep learning models into scalable production services, optimizing inference performance to reduce latency and increase throughput. Collaborate with algorithm and business teams to ship and troubleshoot production deployments, and continuously explore new AI methods and technologies to advance model services.
Location: Singapore
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Convert large-scale deep learning models into scalable model serving services for TikTok Live.
  • •Optimize model inference performance by efficiently using computing resources, minimizing response time, and maximizing throughput.
  • •Collaborate with algorithm and business teams to deploy models into production and resolve production issues.
  • •Monitor and explore new AI technologies and methods to drive technical advancement in model services.

Key Requirements

  • •Bachelor’s degree or higher in Computer Science, Software Engineering, Artificial Intelligence, or a related field.
  • •3+ years of relevant experience deploying and servicing large-scale machine learning models.
  • •Proficiency in deep learning frameworks such as TensorFlow, PyTorch, and DeepSpeed in production environments.
  • •Experience with model inference optimization techniques (e.g., quantization, distillation, distributed inference, ONNX, ZeRO).
  • •Strong programming skills in Python, C++, or Golang, with deep understanding of system performance optimization.
Experience:3+ yearsMachine learningLLMLive streaming
Education:Bachelor's
Skills:Cross-team collaborationTechnical innovationSystem performance optimizationProblem solvingContinuous improvement
Tech Stack:PythonC++GolangTensorFlowPyTorchDeepSpeedONNXZeROQuantizationDistillationDistributed inferenceRPCRedisKafka

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn