AI Software Engineer — High-Performance GPU Communication

AMD
Shanghai
Workplace: OnsiteFull timeCNY 581,350 - 830,500 annuallyFunction: Software EngineeringExperience: 5+ yearsEducation: mastersSkills: ["Problem-solving","Proactive","Collaboration","Analytical thinking","Software engineering best practices"]

Optimize and develop deep learning frameworks for AMD GPUs, focusing on improving GPU kernels, models, and training/inference performance across multi-GPU and multi-node systems. Work with internal GPU library teams and open-source maintainers to integrate optimizations, leveraging compiler technologies to drive continuous performance improvements. Build end-to-end distributed inference and RL solutions using mainstream frameworks such as vLLM and SGlang, while tuning the full deep learning pipeline, including graph compilers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
AMD
AMD
1 day ago

AI Software Engineer — High-Performance GPU Communication

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Optimize and develop deep learning frameworks for AMD GPUs, focusing on improving GPU kernels, models, and training/inference performance across multi-GPU and multi-node systems. Work with internal GPU library teams and open-source maintainers to integrate optimizations, leveraging compiler technologies to drive continuous performance improvements. Build end-to-end distributed inference and RL solutions using mainstream frameworks such as vLLM and SGlang, while tuning the full deep learning pipeline, including graph compilers.
Location: Shanghai
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build and optimize end-to-end distributed inference (including P/D disaggregation and Large-EP) and RL solutions on frameworks like vLLM and SGlang.
  • •Collaborate with internal GPU library teams to analyze and improve training and inference performance on AMD GPUs.
  • •Engage with open-source framework maintainers to align code changes with requirements and integrate upstream.
  • •Optimize deep learning performance across distributed computing environments, including scale-up (multi-GPU) and scale-out (multi-node) systems.
  • •Leverage compiler technologies and graph compilation to enhance the full deep learning pipeline and improve performance.

Pay and Benefits

Salary: CNY 581,350 - 830,500 annually

Key Requirements

  • •5+ years of professional experience in technical software development with a focus on GPU optimization, performance engineering, and framework development.
  • •Master’s or PhD in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
  • •Strong C++ development experience within Linux environments.
  • •Deep experience designing and optimizing GPU kernels for deep learning on AMD GPUs using HIP, CUDA, and assembly (ASM), with knowledge of AMD architectures (GCN, RDNA).
  • •Experience integrating optimized GPU performance into machine learning and LLM frameworks (e.g., vLLM, SGlang, TensorFlow, PyTorch) for scaling and throughput.
Experience:5+ yearsDeep learningGPU optimizationHigh-performance computingLLMsDistributed inference
Education:Master's in Computer Science, Computer Engineering, Electrical Engineering, or related fields
Skills:Problem-solvingProactiveCollaborationAnalytical thinkingSoftware engineering best practices
Languages:English
Tech Stack:C++PythonLinuxHIPCUDAASMGCNRDNAVLLMSGlangTensorFlowPyTorchCompute Kernel (CK)CUTLASSTritonLLVMROCmGraph compilersMulti-GPUMulti-node

Company Brief

AMD
Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1969
Glassdoor
Glassdoor: 3.9
WebsiteLinkedIn