Senior Software Engineer, NCCL

NVIDIA
Santa Clara
Workplace: OnsiteFull timeUSD 152,000 - 287,500 annuallyFunction: Software EngineeringExperience: 5+ yearsEducation: professionalSkills: ["Problem-solving","Communication","Level-headedness"]

Senior software engineer role focused on designing, implementing, and maintaining highly-optimized communication runtimes and system software for GPU clusters, enabling interactions among GPUs and with other system components. Involves contributing to MPI/OpenSHMEM specifications, creating POCs for new runtimes and hardware features, and working on CUDA/NVIDIA GPU communication in HPC and deep learning environments.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
5 months ago

Senior Software Engineer, NCCL

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Senior software engineer role focused on designing, implementing, and maintaining highly-optimized communication runtimes and system software for GPU clusters, enabling interactions among GPUs and with other system components. Involves contributing to MPI/OpenSHMEM specifications, creating POCs for new runtimes and hardware features, and working on CUDA/NVIDIA GPU communication in HPC and deep learning environments.
Location: Santa Clara
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Manager level

Key Responsibilities

  • •Design, implement and maintain highly-optimized communication runtimes for Deep Learning frameworks (e.g. NCCL for TensorFlow/PyTorch) and HPC programming interfaces (e.g. UCX for MPI/OpenSHMEM) on GPU clusters.
  • •Participate in and contribute to parallel programming interface specifications like MPI/OpenSHMEM.
  • •Design, implement and maintain system software that enables interactions among GPUs and interactions between GPUs and other system components.
  • •Create proofs-of-concepts to evaluate and motivate extensions in programming models, new designs in runtimes and new features in hardware.

Pay and Benefits

Salary: USD 152,000 - 287,500 annually
Equity and Bonus:Equity
Perks:Equity

Key Requirements

  • •MS/PhD in CS/CE or equivalent experience
  • •5+ years of relevant experience
  • •Excellent C/C++ programming and debugging skills
  • •Strong experience with Linux
  • •Experience with parallel programming interfaces and communication runtimes
Experience:5+ yearsHigh performance computingGpu computingDeep learningAi
Education:Professional (JD, MD, etc.) in Computer Science/Engineering
Skills:Problem-solvingCommunicationLevel-headedness
Languages:English
Tech Stack:CC++LinuxMPIOpenSHMEMNCCLUCXCUDAGPUPyTorchTensorFlow

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor