Senior Software Engineer, NIM Model Customization

NVIDIA
Santa Clara
Full timeUSD 184,000 - 356,500 annuallyFunction: Software EngineeringExperience: 7+ yearsEducation: bachelorsSkills: ["Collaboration","Problem-solving","Attention to detail","Communication","Mentorship"]

Build a new model customization and deployment lifecycle platform for NVIDIA’s NIMs, defining the product surface used by ISVs and CSPs at international scale. Compose fine-tuning handoff pipelines (LoRA adapter repackaging, re-quantization, re-validation), create an evaluation harness, and implement observability and auditable attestation. Develop durable platform APIs and partner closely with customers to ensure successful, compliance-ready rollouts.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
2 days ago

Senior Software Engineer, NIM Model Customization

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Build a new model customization and deployment lifecycle platform for NVIDIA’s NIMs, defining the product surface used by ISVs and CSPs at international scale. Compose fine-tuning handoff pipelines (LoRA adapter repackaging, re-quantization, re-validation), create an evaluation harness, and implement observability and auditable attestation. Develop durable platform APIs and partner closely with customers to ensure successful, compliance-ready rollouts.
Location: Santa Clara
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Compose and build the fine-tuning handoff pipeline, including LoRA adapter repackaging, re-quantization, and re-validation into NIM.
  • •Develop an evaluation harness to ensure models meet NVIDIA’s standards.
  • •Implement observability and attestation to produce auditable compliance artifacts.
  • •Partner with ISVs and CSPs to roll out NVIDIA NIMs at large scale.
  • •Define and improve durable platform APIs and drive successful project completion with proven methodologies.

Pay and Benefits

Salary: USD 184,000 - 356,500 annually
Equity and Bonus:Equity

Key Requirements

  • •Bachelor’s degree in Computer Science, Engineering, or equivalent experience.
  • •Experience using model customization tools including LoRA, QLoRA, supervised fine-tuning (SFT), reinforcement learning (RL), preference optimization (e.g., DPO), and retrieval-augmented generation (RAG).
  • •7+ years of experience with LLM serving infrastructure (vLLM, TRT-LLM, or equivalent).
  • •Deep understanding of model quantization and fine-tuning workflows.
  • •Experience developing robust platform APIs and strong cross-functional collaboration.
Experience:7+ years
Education:Bachelor's in Computer Science, Engineering
Skills:CollaborationProblem-solvingAttention to detailCommunicationMentorship
Tech Stack:LoRAQLoRASupervised fine-tuning (SFT)Reinforcement learning (RL)Preference optimization (DPO)Retrieval-augmented generation (RAG)VLLMTRT-LLMModel quantizationPlatform APIsObservabilityAuditable compliance artifacts

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor