MLSys Backend Engineer Graduate (AML Ark) - 2027 Start

ByteDance
Singapore
Full timeFunction: Software EngineeringSkills: []

Build and scale ML platform resource scheduling systems that support model training, evaluation, and inference across NLP, computer vision, and speech. Optimize orchestration for heterogeneous compute (GPUs, CPUs, and accelerators) across dedicated, spot, co-located, and multi-cloud resources. Design workload scheduling spanning data centers, regions, and clouds, improving placement of online services and offline batch jobs while maximizing performance and efficiency in large distributed clusters.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
3 days ago

MLSys Backend Engineer Graduate (AML Ark) - 2027 Start

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 hours agoStatus: Live

Job Summary

Build and scale ML platform resource scheduling systems that support model training, evaluation, and inference across NLP, computer vision, and speech. Optimize orchestration for heterogeneous compute (GPUs, CPUs, and accelerators) across dedicated, spot, co-located, and multi-cloud resources. Design workload scheduling spanning data centers, regions, and clouds, improving placement of online services and offline batch jobs while maximizing performance and efficiency in large distributed clusters.
Location: Singapore
Employment Type: Full time
Job Function: Software Engineering
Seniority: Graduate level

Key Responsibilities

  • •Design and develop resource scheduling systems for ML platforms supporting training, evaluation, and inference workloads.
  • •Optimize orchestration and scheduling of heterogeneous computing resources (GPUs, CPUs, specialized accelerators) to maximize utilization.
  • •Develop scheduling solutions that coordinate compute allocation with RDMA high-speed networking and storage resources.
  • •Design and implement workload scheduling across multiple data centers, regions, and cloud environments.
  • •Ensure balanced resource utilization and efficient placement of online services and offline batch jobs.

Key Requirements

  • •Completing or recently completed a Bachelor’s or Master’s degree in computing or a related discipline.
  • •Proficiency in one or more programming languages (Go, Python, or Shell scripting) in a Linux environment.
  • •Strong understanding of Kubernetes architecture and ecosystem, with hands-on experience in container technologies such as Docker, Containerd, Kata Containers, and Podman.
  • •Solid understanding of distributed systems principles, including designing, developing, and maintaining large-scale distributed systems.
  • •Familiarity with at least one ML framework (TensorFlow or PyTorch) and hands-on experience with AI infrastructure, HW/SW co-design, high performance computing, and ML hardware architecture.
Experience:Machine learning systemsAI infrastructureHigh performance computingMulti-cloudDistributed systems
Education:
Tech Stack:GoPythonShell scriptingLinuxKubernetesDockerContainerdKata ContainersPodmanTensorFlowPyTorchGPUCPURDMAMulti-cloudSpot instancesGPUsAcceleratorsHigh-speed networkingStorage

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn