Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)

ByteDance
San Jose
Full timeFunction: Software EngineeringEducation: phdSkills: ["Ownership","Collaboration","Problem-solving","Quantitative thinking","Experimentation"]

Build large-scale machine learning orchestration infrastructure that powers online model serving across ByteDance products. Work on systems for job/service lifecycle management, multi-tenant resource and quota scheduling, and serving orchestration for disaggregated clusters. Improve GPU utilization, serving latency, availability, and reliability while supporting autoscaling, upgrades/rollback, disaster recovery, and traffic/QoS management. Collaborate through hands-on research and engineering projects.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
18 hours ago

Software Engineer Graduate (AML-Engine-Orchestration) - 2027 Start (PhD)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Build large-scale machine learning orchestration infrastructure that powers online model serving across ByteDance products. Work on systems for job/service lifecycle management, multi-tenant resource and quota scheduling, and serving orchestration for disaggregated clusters. Improve GPU utilization, serving latency, availability, and reliability while supporting autoscaling, upgrades/rollback, disaster recovery, and traffic/QoS management. Collaborate through hands-on research and engineering projects.
Location: San Jose
Employment Type: Full time
Job Function: Software Engineering
Seniority: Graduate level

Key Responsibilities

  • •Design and build orchestration capabilities for machine learning platforms, including Kubernetes Operators, container runtimes, and lifecycle management for jobs, services, and stateful workloads.
  • •Build multi-tenant resource and quota systems for priorities, preemption, fair sharing, elasticity, and cross-cluster scheduling to improve GPU utilization and cost efficiency via resource pooling and FinOps.
  • •Develop lifecycle orchestration for online model serving, including model/image distribution, deployment, upgrades, rollback, autoscaling, multi-cluster operation, and disaster recovery.
  • •Build serving orchestration and traffic management for disaggregated serving clusters, including topology-aware scheduling, KV Cache affinity, intelligent request routing, and QoS/SLA management.

Key Requirements

  • •Completing or recently completed a PhD in Computer Science, Software Engineering, Artificial Intelligence, or a related technical field.
  • •Proficiency in at least one of Go, C++, or Python, with strong data structures, algorithms, and software engineering fundamentals.
  • •Familiarity with Linux and foundational concepts in operating systems, computer networks, concurrent programming, and distributed systems.
  • •Strong hands-on, exploratory problem-solving using source code, metrics, logs, profiling, and experiments.
  • •Demonstrated ownership and collaboration through coursework, research, internships, open-source contributions, or engineering projects.
Education:PhD / Doctorate in Computer Science, Software Engineering, Artificial Intelligence (or related technical field)
Skills:OwnershipCollaborationProblem-solvingQuantitative thinkingExperimentation
Tech Stack:GoC++PythonLinuxKubernetesKubernetes OperatorsContainer runtimesFinOpsVolcanoKoordinatorOpenKruiseVLLMSGLangTritonKServeRay ServeKV CacheContinuous BatchingPrefill/Decode disaggregationModel parallelism

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn