ByteDance

2 days ago

Tech Lead Software Engineer - AI Compute Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 33 minutes agoStatus: Live

Job Summary

Build and operate Kubernetes-native infrastructure for large-scale LLM inference, including cluster management and orchestration systems optimized for GPU acceleration. Architect secure, cost-efficient GPU/AI accelerator infrastructure and collaborate cross-functionally to deliver inference solutions using vLLM, SGLang, TensorRT-LLM, and other engines. Stay current with open-source and systems research, and ship production-ready, maintainable code.

Location: Seattle

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design and build large-scale container-based cluster management and orchestration systems with extreme performance, scalability, and resilience.
•Architect cloud-native GPU and AI accelerator infrastructure to deliver cost-efficient and secure ML platforms.
•Collaborate across teams to deliver inference solutions using vLLM, SGLang, TensorRT-LLM, and other LLM engines.
•Monitor and integrate advances in open source (Kubernetes, Ray), AI/ML, and LLM infrastructure and systems research into production.
•Write production-ready code that is maintainable, testable, and scalable.

Key Requirements

•B.S./M.S. in Computer Science, Computer Engineering, or related fields with 5+ years of relevant experience (Ph.D. with strong systems/ML publications considered).
•Strong understanding of large model inference, distributed/parallel systems, and/or high-performance networking.
•Hands-on experience building cloud or ML infrastructure across resource management, scheduling, request routing, monitoring, or orchestration.
•Solid knowledge of container and orchestration technologies such as Docker and Kubernetes.
•Proficiency in at least one major programming language: Go, Rust, Python, or C++.

Experience:5+ yearsLLMAI/MLCloud infrastructureDistributed systemsKubernetesGPUOpen source

Education:Bachelor's in Computer Science, Computer Engineering, or related fields

Skills:CollaborationCommunicationPerformance optimizationSystems thinkingOpen-source contribution

Tech Stack:AIBrixKubernetesDockerRayVLLMSGLangTensorRT-LLMGoRustPythonC++CUDAAWSAzureGCPSageMakerAzure MLVertex AIDeepSpeedPyTorch

Company Brief

ByteDance

Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Beijing, China

Founded: 2012

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

ByteDance

2 days ago

Tech Lead Software Engineer - AI Compute Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 33 minutes agoStatus: Live

Job Summary

Location: Seattle

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design and build large-scale container-based cluster management and orchestration systems with extreme performance, scalability, and resilience.
•Architect cloud-native GPU and AI accelerator infrastructure to deliver cost-efficient and secure ML platforms.
•Collaborate across teams to deliver inference solutions using vLLM, SGLang, TensorRT-LLM, and other LLM engines.
•Monitor and integrate advances in open source (Kubernetes, Ray), AI/ML, and LLM infrastructure and systems research into production.
•Write production-ready code that is maintainable, testable, and scalable.

Key Requirements

•B.S./M.S. in Computer Science, Computer Engineering, or related fields with 5+ years of relevant experience (Ph.D. with strong systems/ML publications considered).
•Strong understanding of large model inference, distributed/parallel systems, and/or high-performance networking.
•Hands-on experience building cloud or ML infrastructure across resource management, scheduling, request routing, monitoring, or orchestration.
•Solid knowledge of container and orchestration technologies such as Docker and Kubernetes.
•Proficiency in at least one major programming language: Go, Rust, Python, or C++.

Experience:5+ yearsLLMAI/MLCloud infrastructureDistributed systemsKubernetesGPUOpen source

Education:Bachelor's in Computer Science, Computer Engineering, or related fields

Skills:CollaborationCommunicationPerformance optimizationSystems thinkingOpen-source contribution

Tech Stack:AIBrixKubernetesDockerRayVLLMSGLangTensorRT-LLMGoRustPythonC++CUDAAWSAzureGCPSageMakerAzure MLVertex AIDeepSpeedPyTorch

Company Brief

ByteDance

Industry: Digital Media

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Established Company

Headquarters: Beijing, China

Founded: 2012

Website LinkedIn