NVIDIA

4 weeks ago

Software Engineer, AI and DL Kernel Libraries

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Join NVIDIA’s AI software team to design, build, and optimize production-quality kernel libraries and inference runtimes that power large language models and AI workloads on NVIDIA GPUs. Contribute across the stack from low-level kernels to runtime abstractions, collaborating with DL frameworks, compilers, and GPU architecture teams to deliver scalable, high-performance AI software.

Location: Shanghai

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Develop production-quality software that ships as part of NVIDIA's AI software stack, including cuDNN and FlashInfer, for large language model inference workloads.
•Innovate and develop new AI systems technologies with focus on performance, scalability, maintainability, and usability.
•Design, implement, and optimize kernels for high-impact AI workloads across LLM inference, generative AI, computer vision, autonomous driving, and recommender systems.
•Design and implement extensible software abstractions for deep learning libraries, LLM serving engines, and runtime systems.
•Build and improve just-in-time compilation, code generation, and runtime technologies for performance-critical GPU workloads.

Key Requirements

•Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent experience.
•3+ years of industry, research, or systems software development experience in machine learning, deep learning systems, compilers, or GPU software.
•Strong programming skills in C/C++ and Python with hands-on experience developing high-performance software.
•Solid experience with CUDA development and GPU programming fundamentals.
•Strong experience developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, or ONNX.

Experience:3+ yearsAIDLGPUInferenceDeep learningFrameworksCUDA

Education:Master's in Computer Science

Skills:CommunicationProblem-solvingTeamwork

Languages:English

Tech Stack:CC++PythonCUDAPyTorchJAXTensorFlowONNXCUDA C/C++CuDNNFlashInferTritonMLIRTVMVLLMSGLang

Company Brief

NVIDIA

Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

NVIDIA

4 weeks ago

Software Engineer, AI and DL Kernel Libraries

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 22 hours agoStatus: Live

Job Summary

Location: Shanghai

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Key Responsibilities

•Develop production-quality software that ships as part of NVIDIA's AI software stack, including cuDNN and FlashInfer, for large language model inference workloads.
•Innovate and develop new AI systems technologies with focus on performance, scalability, maintainability, and usability.
•Design, implement, and optimize kernels for high-impact AI workloads across LLM inference, generative AI, computer vision, autonomous driving, and recommender systems.
•Design and implement extensible software abstractions for deep learning libraries, LLM serving engines, and runtime systems.
•Build and improve just-in-time compilation, code generation, and runtime technologies for performance-critical GPU workloads.

Key Requirements

•Master's degree in Computer Science, Electrical Engineering, or related field, or equivalent experience.
•3+ years of industry, research, or systems software development experience in machine learning, deep learning systems, compilers, or GPU software.
•Strong programming skills in C/C++ and Python with hands-on experience developing high-performance software.
•Solid experience with CUDA development and GPU programming fundamentals.
•Strong experience developing or using deep learning frameworks such as PyTorch, JAX, TensorFlow, or ONNX.

Experience:3+ yearsAIDLGPUInferenceDeep learningFrameworksCUDA

Education:Master's in Computer Science

Skills:CommunicationProblem-solvingTeamwork

Languages:English

Tech Stack:CC++PythonCUDAPyTorchJAXTensorFlowONNXCUDA C/C++CuDNNFlashInferTritonMLIRTVMVLLMSGLang

Company Brief

NVIDIA

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor