Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Software EngineeringEducation: mastersSkills: ["Communication","Team collaboration","System efficiency focus","Quality focus","Performance and scalability focus"]

Build and evolve ByteDance’s compute infrastructure for AI/LLM workloads by enhancing Kubernetes-based cluster management and designing unified scheduling for diverse containers, VMs, and offline jobs. Develop intelligent, AI-driven scheduling to optimize heterogeneous resources across global data centers. Lead next-gen ML training/inference platform improvements, write maintainable infrastructure code, and contribute to open-source initiatives across Kubernetes and serverless ecosystems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Senior Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 30 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and evolve ByteDance’s compute infrastructure for AI/LLM workloads by enhancing Kubernetes-based cluster management and designing unified scheduling for diverse containers, VMs, and offline jobs. Develop intelligent, AI-driven scheduling to optimize heterogeneous resources across global data centers. Lead next-gen ML training/inference platform improvements, write maintainable infrastructure code, and contribute to open-source initiatives across Kubernetes and serverless ecosystems.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Enhance Kubernetes-based cluster platforms for hyper-scale management, improving performance, scalability, and resilience across ByteDance’s global infrastructure.
  • •Design and maintain unified scheduling to support diverse workloads (containers, VMs, online services, offline computing, AI/ML, CPU/GPU workloads) in a massive-scale resource pool.
  • •Build intelligent scheduling systems using AI models to optimize workload performance and resource utilization across heterogeneous resources and global data centers.
  • •Lead the evolution of compute platforms purpose-built for fast, reliable, and cost-effective ML and LLM training/inference.
  • •Write high-quality, maintainable code and stay current with open-source and research advancements in AI/ML, systems, and serverless technologies.

Key Requirements

  • •B.S./M.S. in Computer Science, Computer Engineering, or related field with 3+ years of relevant industry experience (Ph.D. with strong publication records may be an exception).
  • •Solid understanding of Unix/Linux, distributed and parallel systems, high-performance networking, and large-scale software systems.
  • •Proven experience designing and building cloud and ML infrastructure, including resource management/allocation, job scheduling, and monitoring.
  • •Familiarity with container and orchestration technologies such as Docker and Kubernetes.
  • •Proficiency in at least one major programming language: Python, Go, C++, Rust, or Java.
Experience:AI/LLMCloud infrastructureDistributed systemsContainer orchestrationServerlessResource efficiencyJob scheduling
Education:Master's in Computer Science, Computer Engineering, or related area
Skills:CommunicationTeam collaborationSystem efficiency focusQuality focusPerformance and scalability focus
Tech Stack:KubernetesServerlessRayKubewharfAiBrixDockerUnix/LinuxPythonGoC++RustJavaAWSAzureGCPAWS SageMakerAzure MLGCP Vertex AIYarnMesos

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn