Senior Deep Learning Engineer, Accuracy Evaluation

NVIDIA
Poland, Spain, Switzerland, Netherlands, France
Workplace: RemoteFull timePLN 375,000 - 650,000Function: Data Science & Machine LearningExperience: 6+ yearsSkills: ["Clear communication","Precise communication"]

Build decision-grade evaluation environments for NVIDIA’s frontier deep learning models, covering reasoning, multimodal, long-context, and agentic systems. Develop novel evaluation methodologies where benchmarks don’t exist, and create evaluation infrastructure, regression CI, and statistical tooling used across model, product, and applied research teams. Partner with research, training, and customer teams to turn auditable accuracy signals into release decisions, training direction, and competitive positioning.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
NVIDIA
NVIDIA
2 days ago

Senior Deep Learning Engineer, Accuracy Evaluation

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Build decision-grade evaluation environments for NVIDIA’s frontier deep learning models, covering reasoning, multimodal, long-context, and agentic systems. Develop novel evaluation methodologies where benchmarks don’t exist, and create evaluation infrastructure, regression CI, and statistical tooling used across model, product, and applied research teams. Partner with research, training, and customer teams to turn auditable accuracy signals into release decisions, training direction, and competitive positioning.
Location: Poland, Spain, Switzerland, Netherlands, France
Workplace: Remote
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Design and build decision-grade evaluation environments for NVIDIA’s frontier models across reasoning, multimodal, long-context, and agentic systems.
  • •Research and develop novel evaluation methodologies for emerging model families and capability domains where benchmarks don’t exist or don’t generalize.
  • •Build and operate evaluation infrastructure and pipelines, including benchmark environments, regression CI systems, and statistical analysis tooling.
  • •Partner with model research, training, and customer teams to translate evaluation signals into concrete decisions (release go/no-go, training direction, competitive positioning).
  • •Deliver auditable accuracy signals that gate major model releases.

Pay and Benefits

Salary: PLN 375,000 - 650,000

Key Requirements

  • •BS, MS, or PhD in Computer Science, Machine Learning, Statistics, or a related field.
  • •6+ years hands-on experience with LLMs, designing and running evaluations for large language models or multimodal AI systems, including agentic, multi-turn, or reasoning-heavy settings.
  • •Strong statistical foundations, including experimental design, significance testing, regression analysis, and separating signal from noise at scale.
  • •Proven experience building evaluation infrastructure (pipelines, benchmark harnesses, reproducible CI systems), not just consuming existing benchmarks.
  • •Clear, precise communication that translates quantitative evaluation results into decisions for researchers, product teams, and senior leadership.
Experience:6+ yearsLLMsMultimodal AIAgentic systemsHPCAI evaluationDeep learning
Education:
Skills:Clear communicationPrecise communication
Tech Stack:LLMsRAGAgentsVision modelsHPCSlurmRegression CIStatistical analysisMLflowW&BFP8INT4Quantization-aware settingsCalibrationSparsitySWE-benchGAIAWebArena

Company Brief

NVIDIA
Designs and manufactures GPUs, AI accelerators, and system-on-chip products for gaming, data centers, professional visualization, and automotive markets, enabling advanced graphics, AI, and high-performance computing solutions worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1993
Glassdoor
Glassdoor: 4.3
WebsiteLinkedInGlassdoor