Software Engineer Intern (AML-Engine-Orchestration) - 2027 Start

ByteDance
San Jose
InternshipFunction: Software EngineeringEducation: bachelorsSkills: ["Problem-solving","Collaboration","Ownership","Quantitative reasoning","Systems thinking"]

Join the Data-AML-Engine Orchestration team to build large-scale ML infrastructure for production model serving. You’ll design orchestration and scheduling systems spanning Kubernetes operators, container runtimes, multi-tenant resource quotas, and online serving lifecycle (deployments, upgrades, rollbacks, autoscaling, and disaster recovery). Work on serving orchestration and traffic management for disaggregated clusters to improve GPU utilization, latency, availability, and infrastructure reliability while strengthening MLE productivity.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 day ago

Software Engineer Intern (AML-Engine-Orchestration) - 2027 Start

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Join the Data-AML-Engine Orchestration team to build large-scale ML infrastructure for production model serving. You’ll design orchestration and scheduling systems spanning Kubernetes operators, container runtimes, multi-tenant resource quotas, and online serving lifecycle (deployments, upgrades, rollbacks, autoscaling, and disaster recovery). Work on serving orchestration and traffic management for disaggregated clusters to improve GPU utilization, latency, availability, and infrastructure reliability while strengthening MLE productivity.
Location: San Jose
Employment Type: Internship
Job Function: Software Engineering
Seniority: Intern level

Key Responsibilities

  • •Design and build orchestration capabilities for ML platforms, including Kubernetes operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads.
  • •Build multi-tenant resource and quota systems supporting priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling to improve GPU utilization and cost efficiency.
  • •Build lifecycle orchestration for online model serving, including model/image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery.
  • •Build serving orchestration and traffic management for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management.

Key Requirements

  • •Currently pursuing a Bachelor's or Master's degree in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
  • •Proficiency in at least one of Go, C++, or Python, with a solid foundation in data structures, algorithms, and software engineering principles.
  • •Familiarity with Linux and a foundational understanding of operating systems, computer networks, concurrent programming, and distributed systems.
  • •Strong hands-on and exploratory abilities, with a willingness to investigate systems using source code, metrics, logs, profiling, and experiments.
  • •A systematic and quantitative approach to problem solving, including defining measurements, testing hypotheses, and validating improvements.
Education:Bachelor's in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field
Skills:Problem-solvingCollaborationOwnershipQuantitative reasoningSystems thinking
Tech Stack:GoC++PythonLinuxKubernetesContainer runtimesKubernetes OperatorsKV CacheFinOpsVolcanoKoordinatorOpenKruiseVLLMSGLangTritonKServeRay ServeDisaggregated serving clustersAutoscalingDistributed systems

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn