Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD)
ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Software EngineeringEducation: phdSkills: ["Communication","Collaboration","Performance optimization","Open-source innovation","System efficiency"]Build large-scale, container-based cluster management and orchestration systems for GPU-optimized LLM inference infrastructure. Work on cloud-native infrastructure that powers secure, cost-efficient ML platforms, collaborating across teams to deliver inference solutions using vLLM, SGLang, and TensorRT-LLM. Stay current with Kubernetes, Ray, and LLM systems research, contribute production-ready code, and help shape the future of open-source inference infrastructure globally.

