Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA
United States
Workplace: OnsiteFull timeUSD 184,000 - 356,500 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 8+ yearsEducation: bachelorsSkills: ["Communication","Stakeholder collaboration","Problem-solving","Documentation","Adaptability"]

Design and shape architectures for K8s-based AI infrastructure that connect NVIDIA’s world-class AI clusters. Define scalable, interoperable product architectures for performance and datacenter deployment, lead prototyping and testing to validate functionality at scale, and iterate based on feedback. Collaborate across hardware, software, security, and systems teams to integrate networking/compute/storage ecosystems, and partner with customers on POCs and MVPs while producing technical documentation and targeted content.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
4 days ago

Senior Product Architect, K8s-Based AI Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 20 hours agoStatus: Live

Job Summary

Design and shape architectures for K8s-based AI infrastructure that connect NVIDIA’s world-class AI clusters. Define scalable, interoperable product architectures for performance and datacenter deployment, lead prototyping and testing to validate functionality at scale, and iterate based on feedback. Collaborate across hardware, software, security, and systems teams to integrate networking/compute/storage ecosystems, and partner with customers on POCs and MVPs while producing technical documentation and targeted content.
Location: United States
Workplace: Onsite
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Propose new product concepts by staying current with technology trends in AI infrastructure and agentic AI.
  • •Define detailed product architectures covering performance, scalability, interoperability, and datacenter deployment requirements.
  • •Lead prototyping and testing to validate product design and functionality at scale, diagnose bottlenecks, and drive performance innovations.
  • •Collaborate with internal hardware, software, security, and systems teams to ensure integration across networking, compute, and storage ecosystems.
  • •Work with partners and customers to build proof-of-concepts and MVPs and provide comprehensive documentation (technical specs and user guides).

Pay and Benefits

Salary: USD 184,000 - 356,500 annually
Equity and Bonus:Equity

Key Requirements

  • •8+ years architecting datacenter-scale HPC or AI infrastructure (e.g., Principal Architect, Solutions Architect, Principal Engineer, or equivalent).
  • •Bachelor’s degree in computer science or related field (or equivalent experience).
  • •Strong background enabling large-scale infrastructure management across complex systems, networks, and storage.
  • •Extensive DevOps experience including Python, Ansible, container runtimes, Kubernetes, and datacenter deployments.
  • •Familiarity with AI workloads such as agentic & RAG workflows, inference at scale, training/fine-tuning, and model evaluation.
Experience:8+ yearsHPCAI infrastructureDevOpsDatacenter deploymentsAgentic AIRAG
Education:Bachelor's in computer science
Skills:CommunicationStakeholder collaborationProblem-solvingDocumentationAdaptability
Tech Stack:PythonAnsibleContainer RuntimesKubernetesAI workloadsAgentic AIRAGDatacenter deploymentsDevOps

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor