Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

ByteDance
Seattle
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 3+ yearsEducation: bachelorsSkills: ["Communication","Teamwork","System efficiency focus"]

Build and optimize ByteDance’s compute infrastructure for demanding AI/LLM workloads. You’ll enhance Kubernetes-based cluster management, design unified scheduling for heterogeneous resources, and develop intelligent, AI-driven scheduling to improve performance and cost efficiency across global data centers. Work on next-gen ML compute platforms for fast, reliable training and inference, while writing maintainable code and contributing to open-source and research innovations in systems and serverless technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 29 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and optimize ByteDance’s compute infrastructure for demanding AI/LLM workloads. You’ll enhance Kubernetes-based cluster management, design unified scheduling for heterogeneous resources, and develop intelligent, AI-driven scheduling to improve performance and cost efficiency across global data centers. Work on next-gen ML compute platforms for fast, reliable training and inference, while writing maintainable code and contributing to open-source and research innovations in systems and serverless technologies.
Location: Seattle
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Enhance Kubernetes-based cluster platforms to deliver performance, scalability, and resilience for global resource management.
  • •Design and maintain unified scheduling for diverse workloads (containers/VMs, online/offline computing, AI/ML, CPU/GPU workloads).
  • •Develop intelligent scheduling using AI models to optimize workload performance and resource utilization across heterogeneous resources.
  • •Design and drive evolution of compute platforms for fast, reliable, and cost-effective ML and LLM training/inference.
  • •Write high-quality, maintainable code and stay current with open-source and research advancements in AI/ML, systems, and serverless technologies.

Key Requirements

  • •BS/MS in Computer Science/Computer Engineering (or related) with 3+ years of relevant industry experience; PhD with strong publication records may be an exception.
  • •Solid understanding of Unix/Linux, distributed/parallel systems, high-performance networking, or large-scale software systems.
  • •Proven experience designing, architecting, and building cloud and ML infrastructure for resource management, allocation, job scheduling, and monitoring.
  • •Familiarity with container and orchestration technologies such as Docker and Kubernetes.
  • •Proficiency in at least one major programming language such as Python, Go, C++, Rust, or Java.
Experience:3+ yearsAI/MLLLMCloud infrastructureDistributed systems
Education:Bachelor's in Computer Science or Computer Engineering (or related)
Skills:CommunicationTeamworkSystem efficiency focus
Tech Stack:KubernetesServerlessRayDockerUnix/LinuxPythonGoC++RustJavaAWSAzureGCPAWS SageMakerAzure MLGCP Vertex AIAiBrixKubewharfLLMAI/ML

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn