Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA
Santa Clara
Workplace: HybridFull timeUSD 184,000 - 287,500 annuallyFunction: Software EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Collaboration","Autonomy","Creativity","Driven","Reliability"]

Build and maintain the infrastructure that delivers TensorRT Edge-LLM, enabling scalable, modular development, build, and test across NVIDIA edge platforms. Own CI/CD pipelines to automate build, test, and deployment, configure deployment toolchains and orchestration (e.g., Kubernetes and Docker), and improve reliability through monitoring of embedded and desktop CPU/GPU systems. Address security CVEs across infrastructure components and expand the software stack from UX to cluster layers, collaborating with autonomy teams and external partners.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
2 days ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 23 hours agoStatus: Live

Job Summary

Build and maintain the infrastructure that delivers TensorRT Edge-LLM, enabling scalable, modular development, build, and test across NVIDIA edge platforms. Own CI/CD pipelines to automate build, test, and deployment, configure deployment toolchains and orchestration (e.g., Kubernetes and Docker), and improve reliability through monitoring of embedded and desktop CPU/GPU systems. Address security CVEs across infrastructure components and expand the software stack from UX to cluster layers, collaborating with autonomy teams and external partners.
Location: Santa Clara
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build and maintain infrastructure from first principles to deliver TensorRT Edge-LLM.
  • •Maintain CI/CD pipelines to automate build, test, and deployment and reduce build/test bottlenecks.
  • •Configure, maintain, and extend deployments of industry-standard tools (e.g., CMake, GitLab, GitHub Actions, Kubernetes, Docker).
  • •Develop across the software stack, from user experience and interfaces down to cluster layers.
  • •Monitor and configure embedded and desktop CPU/GPU systems to ensure high CI/CD reliability and perform security CVE scans for infrastructure components.

Pay and Benefits

Salary: USD 184,000 - 287,500 annually
Equity and Bonus:Equity

Key Requirements

  • •BS or equivalent experience, or higher degree, in Computer Science or Computer Engineering.
  • •7+ years of proven experience.
  • •Strong programming skills in Python (or similar) and familiarity with modern C/C++ development.
  • •Experience setting up, maintaining, and automating continuous integration systems (e.g., Jenkins, GitHub Actions, GitLab CI).
  • •Experience administering, monitoring, and deploying systems and services on GitHub and cloud platforms (e.g., AWS, GCP, Azure).
Experience:7+ yearsEdge AILLMEmbeddedAutomotiveCloud
Education:Bachelor's
Skills:CollaborationAutonomyCreativityDrivenReliability
Tech Stack:TensorRTTensorRT-LLMPythonCC++CMakeGitLabGitHub ActionsKubernetesDockerCI/CDJenkinsAWSGCPAzureGitPerforceMakeBazelVLLM

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor