Staff Software Engineer, Model Infrastructure

Lead the design and development of a Model Infrastructure platform powering every AI request. Build highly available, low-latency systems for AI inference, including Harvey’s Unified Model Controller (UMC) and Model Selector for model health detection and intelligent routing. Develop provisioning, capacity management, failover, and traffic engineering across multiple model providers while improving observability, cost visibility, and operational excellence. Mentor engineers and partner with AI Research and Product Engineering on production AI workloads.