Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 2+ yearsEducation: bachelorsSkills: ["Communication","Teamwork","System efficiency","Quality","Performance","Scalability"]

Build and scale ByteDance’s compute infrastructure for AI/LLM workloads by enhancing Kubernetes-based cluster platforms and delivering resilient hyper-scale scheduling. Design unified scheduling for diverse container/VM and online/offline workloads, and develop intelligent, AI-driven systems to optimize heterogeneous resources across global data centers. Contribute to next-gen ML training and inference compute platforms while writing high-quality, maintainable code and advancing open-source infrastructure technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Software Engineer - Compute Infrastructure (Orchestration & Scheduling)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 30 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Build and scale ByteDance’s compute infrastructure for AI/LLM workloads by enhancing Kubernetes-based cluster platforms and delivering resilient hyper-scale scheduling. Design unified scheduling for diverse container/VM and online/offline workloads, and develop intelligent, AI-driven systems to optimize heterogeneous resources across global data centers. Contribute to next-gen ML training and inference compute platforms while writing high-quality, maintainable code and advancing open-source infrastructure technologies.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Enhance Kubernetes-based cluster platforms for performance, scalability, and resilience, enabling resource management across ByteDance’s global infrastructure.
  • •Design and maintain unified scheduling for diverse workloads including containers and VMs, online services, offline computing, and AI/ML CPU/GPU workloads.
  • •Develop an intelligent scheduling system using AI models to optimize workload performance and resource utilization across heterogeneous resources.
  • •Design and drive next-gen compute platforms purpose-built for fast, reliable, and cost-effective ML and LLM training/inference.
  • •Write high-quality, maintainable code and stay current with open-source and research advancements in AI, ML, systems, and serverless technologies.

Key Requirements

  • •BS/MS in Computer Science, Computer Engineering, or related field with 2+ years of relevant industry experience (PhD with strong publications may be an exception).
  • •Solid understanding of Unix/Linux environments, distributed/parallel systems, high-performance networking, and large-scale software systems.
  • •Proven experience designing and building cloud and ML infrastructure for resource management, allocation, job scheduling, and monitoring.
  • •Familiarity with container and orchestration technologies such as Docker and Kubernetes.
  • •Proficiency in at least one major programming language such as Python, Go, C++, Rust, or Java.
Experience:2+ yearsAILLMsCloudMLDistributed systemsContainersOrchestrationData centers
Education:Bachelor's in Computer Science, Computer Engineering or a related area
Skills:CommunicationTeamworkSystem efficiencyQualityPerformanceScalability
Tech Stack:KubernetesServerlessRayKubewharfAiBrixDockerUnixLinuxPythonGoC++RustJavaAWSAzureGCPAWS SageMakerAzure MLGCP Vertex AICPU

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn