Senior Software Architect, AI Systems and Networking

NVIDIA
Santa Clara, Austin
Workplace: HybridFull timeUSD 184,000 - 356,500 annuallyFunction: Software EngineeringExperience: 8+ yearsEducation: bachelorsSkills: ["Collaboration","Communication","Problem-solving"]

Lead design and implementation of AI networking solutions for high-throughput, low-latency inference workloads across distributed AI systems. Collaborate with hardware, software, and research teams to co-design accelerator-enabled AI inference solutions, prototype next-generation AI inference architectures, and drive scalable deployment decisions using NVIDIA technologies.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
5 months ago

Senior Software Architect, AI Systems and Networking

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Lead design and implementation of AI networking solutions for high-throughput, low-latency inference workloads across distributed AI systems. Collaborate with hardware, software, and research teams to co-design accelerator-enabled AI inference solutions, prototype next-generation AI inference architectures, and drive scalable deployment decisions using NVIDIA technologies.
Location: Santa Clara, Austin
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Research, design, and implement advanced AI networking technologies with emphasis on accelerating inference workloads using NVIDIA Inference Xfer Library (NIXL)
  • •Collaborate with teams across NVIDIA’s hardware, software, and research units to co-design hardware-accelerated and software solutions for AI inference
  • •Own the creation of prototypes and solutions for next-generation AI inference systems
  • •Drive architectural decisions underpinning the deployment and scaling of AI inference using NVIDIA’s technology

Pay and Benefits

Salary: USD 184,000 - 356,500 annually
Equity and Bonus:Equity
Perks:Equity

Key Requirements

  • •Master's or Ph.D. in Computer Science, Electrical or Computer Engineering or equivalent experience
  • •At least 8 years of relevant academic or confirmed experience in the field
  • •Comprehensive understanding of AI workloads (primarily inference, but also training) and their impact on network infrastructure
  • •Strong proficiency in Machine Learning/Deep Learning fundamentals, inference runtimes, and Deep Learning frameworks
  • •Proficiency in C or C++ for systems software development; familiarity with Rust is an advantage
Experience:8+ yearsAIInferenceDistributed systems
Education:Bachelor's
Skills:CollaborationCommunicationProblem-solving
Tech Stack:CC++RustNIXLGPUInference

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor