Software Engineer Project Intern (Model Infrastructure) - 2026 Start (BS/MS)

TikTok
San Jose
Workplace: OnsiteInternshipFunction: Software EngineeringEducation: bachelorsSkills: ["System-level problem solving","Learning on the job"]

Join TikTok’s Model Infrastructure team to improve engineering efficiency and architecture for large recommendation and LLM2Rec systems. You’ll work on project-based initiatives spanning training and inference optimization, memory-efficient integration of LLMs into the recommendation stack, high-concurrency sparse/dense streaming, hardware-aware co-design for GPU/NPU clusters, and distributed state management across heterogeneous memory hierarchies. Apply early as reviews are rolling.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
TikTok
TikTok
1 month ago

Software Engineer Project Intern (Model Infrastructure) - 2026 Start (BS/MS)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Join TikTok’s Model Infrastructure team to improve engineering efficiency and architecture for large recommendation and LLM2Rec systems. You’ll work on project-based initiatives spanning training and inference optimization, memory-efficient integration of LLMs into the recommendation stack, high-concurrency sparse/dense streaming, hardware-aware co-design for GPU/NPU clusters, and distributed state management across heterogeneous memory hierarchies. Apply early as reviews are rolling.
Location: San Jose
Workplace: Onsite
Employment Type: Internship
Job Function: Software Engineering
Seniority: Intern level

Key Responsibilities

  • •Optimize training and inference pipelines to maximize hardware utilization (MFU/HFU) for very large dense-parameter models
  • •Architect infrastructure to integrate LLMs into the recommendation stack, including memory-efficient attention and KV cache management
  • •Build and optimize high-concurrency engines for Petabyte-scale sparse/dense streaming training with stable continuous updates
  • •Collaborate with researchers on hardware-aware co-design for next-generation recommendation architectures across GPU/NPU interconnects
  • •Innovate distributed state management for storing and synchronizing massive model states across heterogeneous memory hierarchies (HBM, DDR, NVMe)

Key Requirements

  • •Currently pursuing an undergraduate or master’s degree in software development, computer science, computer engineering, or a related technical discipline
  • •Strong programming skills in C++ and Python
  • •Solid understanding of computer architecture and the GPU software stack (CUDA, Triton, or NCCL)
  • •Experience with deep learning frameworks (PyTorch, TensorFlow) and interest in model execution runtimes
  • •A strong interest in solving system-level bottlenecks in large-scale distributed environments
Experience:Deep learningDistributed systemsHigh-performance computingArtificial intelligence
Education:Bachelor's in Software Development, Computer Science, Computer Engineering, or related technical discipline
Skills:System-level problem solvingLearning on the job
Tech Stack:C++PythonCUDATritonNCCLPyTorchTensorFlowTorch.compileTorchDynamoTorchInductorUCXRDMATransformerTP/PP/DPHBMDDRNVMeGPUNPUGPU/NPU interconnects

Company Brief

TikTok
Short-form video platform that lets users create, share, and discover entertainment content through algorithmic recommendations. It also offers advertising and creator tools for brands, influencers, and businesses.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Growth: Scaleup
Headquarters: Singapore, Singapore
Founded: 2016
WebsiteLinkedIn