Senior Software Engineer, AI Platform

Harvey
San Francisco
Workplace: HybridFull timeUSD 185,000 - 325,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["Communication","Problem-solving","Leadership"]

Design and build platform-level backend systems for Harvey’s AI foundation, including model routing, context management, and evaluation infra, to support multi-model AI products and agent infrastructure. Collaborate with product teams to deploy foundation models and ship AI-powered features at scale, with ownership from design through delivery.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Harvey
Harvey
4 months ago

Senior Software Engineer, AI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Design and build platform-level backend systems for Harvey’s AI foundation, including model routing, context management, and evaluation infra, to support multi-model AI products and agent infrastructure. Collaborate with product teams to deploy foundation models and ship AI-powered features at scale, with ownership from design through delivery.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
  • •Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context.
  • •Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively.
  • •Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products.
  • •Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

Pay and Benefits

Salary: USD 185,000 - 325,000 annually
Equity and Bonus:Equity

Key Requirements

  • •5+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering; staff candidates typically 8+ years and technical leadership
  • •Experience building and shipping multi-model or multi-provider AI systems in production
  • •Familiarity with context management, session state, or memory systems in AI or distributed systems
  • •Track record of building internal platforms, SDKs, or shared infrastructure adopted by other engineering teams
  • •Strong judgment about abstractions and pragmatic shipping; ownership mindset and ability to navigate ambiguity
Experience:5+ yearsAIMLBackend systems
Skills:CommunicationProblem-solvingLeadership
Tech Stack:AIFoundation modelsSDKsModel routingContext managementMemory systemsEvaluation infrastructure

Company Brief

Harvey
Harvey builds domain-specific generative AI for legal and professional services, automating contract analysis, due diligence, compliance, and litigation workflows for law firms and corporate legal teams.
Industry: LegalTech
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor