NVIDIA

1 month ago

AI Computing Development Engineer, TensorRT and TensorRT-LLM

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms, collaborating with hardware, software, and research teams to advance NVIDIA’s AI inference stack and publish results at leading conferences.

Location: Shanghai

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms.
•Perform performance analysis, optimization, and tuning of deep learning inference workloads.
•Track and integrate academic and industry advancements in AI and feature updates to TensorRT/TensorRT-LLM.
•Provide feedback into architecture and hardware design and development.
•Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms.

Key Requirements

•Masters or higher in Computer Engineering, Computer Science, Applied Mathematics, or related field (or equivalent experience)
•Strong C/C++ or Python programming with debugging, performance profiling, and test design
•2+ years working experience
•Strong curiosity about AI and familiarity with deep learning advances (generative models, multimodal systems, large neural networks)
•Experience with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, NeMo, or vLLM

Experience:2+ yearsAIDeep learningGPUInference

Education:Master's

Skills:CommunicationProblem-solvingProactivityTeam collaboration

Languages:English

Tech Stack:C++PythonPyTorchTensorRTTensorRT-LLMNeMoVLLM

Company Brief

NVIDIA

Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

NVIDIA

1 month ago

AI Computing Development Engineer, TensorRT and TensorRT-LLM

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 2 hours agoStatus: Live

Job Summary

Location: Shanghai

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Mid level

Key Responsibilities

•Design and develop robust inferencing software (TensorRT/TensorRT-LLM) optimized for functionality and performance across platforms.
•Perform performance analysis, optimization, and tuning of deep learning inference workloads.
•Track and integrate academic and industry advancements in AI and feature updates to TensorRT/TensorRT-LLM.
•Provide feedback into architecture and hardware design and development.
•Collaborate across hardware, software, and research teams to shape the direction of machine learning inferencing across NVIDIA platforms.

Key Requirements

•Masters or higher in Computer Engineering, Computer Science, Applied Mathematics, or related field (or equivalent experience)
•Strong C/C++ or Python programming with debugging, performance profiling, and test design
•2+ years working experience
•Strong curiosity about AI and familiarity with deep learning advances (generative models, multimodal systems, large neural networks)
•Experience with deep learning frameworks such as PyTorch, TensorRT/TensorRT-LLM, NeMo, or vLLM

Experience:2+ yearsAIDeep learningGPUInference

Education:Master's

Skills:CommunicationProblem-solvingProactivityTeam collaboration

Languages:English

Tech Stack:C++PythonPyTorchTensorRTTensorRT-LLMNeMoVLLM

Company Brief

NVIDIA

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor