Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start

ByteDance
San Jose
Workplace: OnsiteInternshipFunction: Data Science & Machine LearningSkills: ["Ownership","Collaboration","Exploratory skills","Problem-solving","Quantitative thinking"]

Build large-scale orchestration for ByteDance’s production machine learning serving stack. You’ll design and implement scheduling, resource/quota management, and lifecycle orchestration for distributed workloads—covering Kubernetes operators, container runtimes, model/image distribution, autoscaling, rollback, and disaster recovery. Work on serving orchestration and traffic management for disaggregated clusters, improving GPU utilization, serving latency, reliability, and MLE productivity.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
16 hours ago

Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 16 hours agoStatus: Live

Job Summary

Build large-scale orchestration for ByteDance’s production machine learning serving stack. You’ll design and implement scheduling, resource/quota management, and lifecycle orchestration for distributed workloads—covering Kubernetes operators, container runtimes, model/image distribution, autoscaling, rollback, and disaster recovery. Work on serving orchestration and traffic management for disaggregated clusters, improving GPU utilization, serving latency, reliability, and MLE productivity.
Location: San Jose
Workplace: Onsite
Employment Type: Internship
Job Function: Data Science & Machine Learning
Seniority: Intern level

Key Responsibilities

  • •Design and build foundational orchestration capabilities for ML platforms, including Kubernetes Operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads.
  • •Build multi-tenant resource and quota systems supporting priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling to improve GPU utilization and cost efficiency.
  • •Implement lifecycle orchestration for online model serving, covering model/image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery.
  • •Develop serving orchestration and traffic management for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management.

Key Requirements

  • •Currently pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
  • •Proficiency in at least one of Go, C++, or Python, with a solid foundation in data structures, algorithms, and software engineering.
  • •Familiarity with Linux and a foundational understanding of operating systems, computer networks, concurrent programming, and distributed systems.
  • •Strong hands-on and exploratory skills using source code, metrics, logs, profiling, and experiments to investigate systems.
  • •A systematic, quantitative approach to problem solving, including defining measurements, testing hypotheses, and validating improvements.
Experience:Machine learning infrastructureModel servingDistributed systemsOpen source
Education:
Skills:OwnershipCollaborationExploratory skillsProblem-solvingQuantitative thinking
Tech Stack:GoC++PythonLinuxKubernetesContainer runtimesKubernetes OperatorsKV CacheFinOpsVolcanoKoordinatorOpenKruiseVLLMSGLangTritonKServeRay ServeDisaster recovery

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn