NVIDIA

3 months ago

Senior Software Engineer, LLM Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 6 hours agoStatus: Live

Job Summary

Senior Software Engineer focused on performance optimization and generative AI, integrating the latest LLM inference research into production across NVIDIA hardware from data centers to edge devices. You will implement and optimize inference algorithms, profile pipelines, and build production-grade software in major open-source libraries, collaborating with research, product, and engineering teams worldwide.

Location: Tel Aviv

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Implement and optimize inference algorithms for LLM and omnimodal architectures, including hybrid Mamba-Transformer and mixture-of-experts models
•Profile inference pipelines using NVIDIA's profiling and simulation tools; correlate simulation predictions against real hardware across data center and edge devices
•Write and tune GPU kernels (CUDA, Triton) for operators like fused MoE layers, SSM state updates, and quantized GEMMs
•Solve distributed inference problems: expert parallelism, communication-compute overlap, collective tuning, multi-node deployment
•Build production-grade software inside major open-source libraries - vLLM, SGLang, Dynamo, FlashInfer

Key Requirements

•5+ years of hands-on software engineering experience in performance-critical systems
•B.Sc., M.Sc., or equivalent experience in Computer Science or Computer Engineering
•Solid understanding of deep learning architectures (Transformers, SSMs, MoE)
•Experience with systems where hardware constraints matter: GPU programming, memory hierarchy, networking, or distributed computing
•Strong software engineering fundamentals: clean design, extensibility, testability. Good judgment about when complexity is warranted

Experience:5+ yearsDeep learningAILLMsDistributed computing

Education:Bachelor's

Skills:CUDATritonGPUPythonPyTorchNsightProfilersMoETransformers

Languages:English

Tech Stack:CUDATritonGPUNsightPyTorchTransformerMoEVLLMSGLangDynamoFlashInferGEMMs

Company Brief

NVIDIA

Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

NVIDIA

3 months ago

Senior Software Engineer, LLM Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 6 hours agoStatus: Live

Job Summary

Location: Tel Aviv

Workplace: Onsite

Employment Type: Full time

Job Function: Software Engineering

Seniority: Sr. Manager level

Key Responsibilities

•Implement and optimize inference algorithms for LLM and omnimodal architectures, including hybrid Mamba-Transformer and mixture-of-experts models
•Profile inference pipelines using NVIDIA's profiling and simulation tools; correlate simulation predictions against real hardware across data center and edge devices
•Write and tune GPU kernels (CUDA, Triton) for operators like fused MoE layers, SSM state updates, and quantized GEMMs
•Solve distributed inference problems: expert parallelism, communication-compute overlap, collective tuning, multi-node deployment
•Build production-grade software inside major open-source libraries - vLLM, SGLang, Dynamo, FlashInfer

Key Requirements

•5+ years of hands-on software engineering experience in performance-critical systems
•B.Sc., M.Sc., or equivalent experience in Computer Science or Computer Engineering
•Solid understanding of deep learning architectures (Transformers, SSMs, MoE)
•Experience with systems where hardware constraints matter: GPU programming, memory hierarchy, networking, or distributed computing
•Strong software engineering fundamentals: clean design, extensibility, testability. Good judgment about when complexity is warranted

Experience:5+ yearsDeep learningAILLMsDistributed computing

Education:Bachelor's

Skills:CUDATritonGPUPythonPyTorchNsightProfilersMoETransformers

Languages:English

Tech Stack:CUDATritonGPUNsightPyTorchTransformerMoEVLLMSGLangDynamoFlashInferGEMMs

Company Brief

NVIDIA

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1993

Glassdoor: 4.3

Website LinkedIn Glassdoor