Senior Software Engineer, AI Platform

Harvey
New York
Workplace: HybridFull timeUSD 193,400 - 290,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["Technical leadership","Good judgment","Pragmatic execution","Ownership","Collaboration"]

Build the AI Platform foundation that powers all of Harvey’s agentic products. You’ll design and ship platform-level abstractions for context management, session state, and memory, and own infrastructure for model onboarding, routing, and evaluation. Partner with product engineering, PMs, and design to launch AI products, and continuously evaluate, prototype, and integrate new advancements to improve reliability and AI quality.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Harvey
Harvey
1 month ago

Senior Software Engineer, AI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live
Reposted: similar role first listed 5 months ago

Job Summary

Build the AI Platform foundation that powers all of Harvey’s agentic products. You’ll design and ship platform-level abstractions for context management, session state, and memory, and own infrastructure for model onboarding, routing, and evaluation. Partner with product engineering, PMs, and design to launch AI products, and continuously evaluate, prototype, and integrate new advancements to improve reliability and AI quality.
Location: New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
  • •Own infrastructure for model integration, routing, and evaluation so the right foundation model is chosen and deployed per context.
  • •Build evaluation frameworks and tooling so teams can iterate on AI quality effectively.
  • •Partner closely with product engineering teams, PMs, and design to launch AI products.
  • •Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

Pay and Benefits

Salary: USD 193,400 - 290,000 annually
Equity and Bonus:Equity

Key Requirements

  • •5+ years building backend systems, including 1+ year focused on AI/ML engineering (staff candidates typically have 8+ years and technical leadership).
  • •Experience building and shipping multi-model or multi-provider AI systems in production.
  • •Familiarity with context management, session state, or memory systems in AI or distributed systems.
  • •Track record building internal platforms, SDKs, or shared infrastructure adopted by other engineering teams, with strong developer-experience focus.
  • •Strong judgment about abstractions and a bias toward full ownership; ship pragmatically and navigate ambiguity.
Experience:5+ yearsAI/ML engineeringAgentic AIMulti-model AI
Skills:Technical leadershipGood judgmentPragmatic executionOwnershipCollaboration

Company Brief

Harvey
Harvey builds domain-specific generative AI for legal and professional services, automating contract analysis, due diligence, compliance, and litigation workflows for law firms and corporate legal teams.
Industry: LegalTech
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor