Sr. Software Engineer - AI Triton Communication

AMD
San Jose
Workplace: HybridFull timeUSD 164,000 - 246,000 annuallyFunction: Software EngineeringEducation: mastersSkills: ["Problem-solving","Communication","Technical leadership"]

Advance the Triton compiler and runtime for AMD CDNA and next-generation GPU architectures by building native distributed execution and communication capabilities. Design and implement primitives for collective operations, remote memory access, synchronization, and scalable multi-GPU execution. Drive performance optimization across compute and inter-GPU data movement, and analyze/debug cross-stack issues spanning Triton, the ROCm stack, and GPU hardware. Collaborate across compiler, runtime, and GPU architecture teams and contribute to the Triton/ROCm distributed ecosystem.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
AMD
AMD
2 days ago

Sr. Software Engineer - AI Triton Communication

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Advance the Triton compiler and runtime for AMD CDNA and next-generation GPU architectures by building native distributed execution and communication capabilities. Design and implement primitives for collective operations, remote memory access, synchronization, and scalable multi-GPU execution. Drive performance optimization across compute and inter-GPU data movement, and analyze/debug cross-stack issues spanning Triton, the ROCm stack, and GPU hardware. Collaborate across compiler, runtime, and GPU architecture teams and contribute to the Triton/ROCm distributed ecosystem.
Location: San Jose
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and develop native distributed communication and execution capabilities within the Triton AMDGPU backend for scalable multi-GPU AI workloads.
  • •Build Triton compiler and runtime mechanisms for GPU-initiated communication, including collective operations, remote memory access, synchronization, and distributed execution primitives.
  • •Drive performance optimization across compute and communication, including inter-GPU data movement, communication/computation overlap, memory hierarchy utilization, and GPU-driven scheduling efficiency.
  • •Develop and optimize distributed Triton kernels and execution models to achieve high performance, scalability, and efficient hardware utilization.
  • •Analyze, profile, and debug complex cross-stack issues spanning Triton compiler, runtime, ROCm stack, and GPU hardware execution.

Pay and Benefits

Salary: USD 164,000 - 246,000 annually

Key Requirements

  • •Deep expertise in GPU architecture, compiler technologies, and distributed GPU systems, with proven experience optimizing at multi-GPU scale.
  • •Comfort working across the full execution stack from compiler and runtime to hardware, understanding how memory hierarchy and inter-GPU communication affect performance.
  • •Experience working close to the GPU runtime, communication stack, or compiler backend, focused on native distributed execution and communication.
  • •Experience profiling, debugging, and optimizing performance across compiler, runtime, and hardware layers for large-scale AI/HPC workloads.
  • •Familiarity with Triton compiler/runtime and distributed GPU communication libraries and ecosystems (e.g., NCCL/RCCL/MPI/SHMEM, ROCm/HIP/CUDA).
Experience:Distributed systemsGPU computingHPCMachine learningOpen sourceTritonROCm
Education:Master's in Computer Engineering, Computer Science, Electrical Engineering
Skills:Problem-solvingCommunicationTechnical leadership
Languages:English
Tech Stack:TritonPyTorchVLLMSGLangROCmHIPCUDAMLIRLLVMXGMINVLinkPCIeInfiniBandRCCLNCCLNVSHMEMRocSHMEMMPIOpen-source

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

AMD
Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1969
Glassdoor
Glassdoor: 3.9
WebsiteLinkedIn