Engineering Manager, Model Infrastructure

Harvey
San Francisco
Workplace: HybridFull timeUSD 272,000 - 355,000 annuallyFunction: Solutions Engineering & Sales EngineeringExperience: 8+ yearsSkills: ["Leadership","Cross-functional leadership","Communication","Technical mentoring","Operational ownership"]

Lead and grow the engineering team that powers Harvey’s Model Infrastructure platform across multiple AI providers. Own the reliability, scalability, and cost-efficiency roadmap, including model provisioning, failover, incident response, and observability. Drive the Unified Model Controller and Model Selector for health-based traffic routing, support model launches and experimentation with Product Engineering, and build foundations for future frontier model training efforts.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Harvey
Harvey
1 month ago

Engineering Manager, Model Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 18 hours agoStatus: Live

Job Summary

Lead and grow the engineering team that powers Harvey’s Model Infrastructure platform across multiple AI providers. Own the reliability, scalability, and cost-efficiency roadmap, including model provisioning, failover, incident response, and observability. Drive the Unified Model Controller and Model Selector for health-based traffic routing, support model launches and experimentation with Product Engineering, and build foundations for future frontier model training efforts.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Solutions Engineering & Sales Engineering
Seniority: Sr. Director level

Key Responsibilities

  • •Lead and grow a high-performing team of software engineers for the Model Infrastructure platform.
  • •Define the technical roadmap for model reliability, scalability, and operational excellence.
  • •Build and operate systems for model provisioning, capacity management, failover, and incident response across providers.
  • •Own the multi-provider model platform, including provider integrations, SDK upgrades, API migrations, and onboarding new providers.
  • •Improve observability and drive model traffic routing using the Unified Model Controller and Model Selector based on health, latency, quality, compliance, and cost.

Pay and Benefits

Salary: USD 272,000 - 355,000 annually

Key Requirements

  • •8+ years of software engineering experience, including multiple years managing high-performing engineering teams.
  • •Experience leading teams responsible for large-scale distributed systems or cloud infrastructure.
  • •Strong technical background to guide architectural decisions and mentor senior engineers.
  • •Experience operating highly available production services with strong reliability and operational excellence.
  • •Experience building platforms requiring scalability, observability, automation, and cost optimization.
Experience:8+ yearsDistributed systemsCloud infrastructureAI infrastructureLLM servingMachine learning
Skills:LeadershipCross-functional leadershipCommunicationTechnical mentoringOperational ownership
Tech Stack:Unified Model Controller (UMC)Model SelectorAPI migrationsKubernetesSparkKafkaFlinkAirflowIceberg

Company Brief

Harvey
Harvey builds domain-specific generative AI for legal and professional services, automating contract analysis, due diligence, compliance, and litigation workflows for law firms and corporate legal teams.
Industry: LegalTech
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor