Senior Research Engineer - Enterprise Products

Develop and evaluate routing policies to optimize LLM traffic across a mixture of model systems. Build and run agentic benchmarks (e.g., Terminal-Bench), convert results into calibration data and routing profiles, and publish design docs and code to open-source communities. Partner across NVIDIA teams to ensure seamless integration with the accelerated serving stack, applying deep learning and empirical research methods to improve generative AI inference.