Staff Software Engineer, AI Platform

Harvey
New York
Workplace: HybridFull timeUSD 231,000 - 340,000 annuallyFunction: Software EngineeringExperience: 8+ yearsSkills: ["Technical leadership","Good judgment","Pragmatic execution","Ownership","Collaboration"]

Build the foundation of Harvey’s agentic AI products by designing platform-level systems for context management, session state, memory, model integration, routing, and evaluation. Own shared infrastructure and abstractions (including SDKs and developer tooling) so product teams can reliably onboard models, measure AI quality, and ship AI-powered features. Partner with product engineering, PMs, and design while evaluating and integrating new AI advancements.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Harvey
Harvey
1 month ago

Staff Software Engineer, AI Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live
Reposted: similar role first listed 4 months ago

Job Summary

Build the foundation of Harvey’s agentic AI products by designing platform-level systems for context management, session state, memory, model integration, routing, and evaluation. Own shared infrastructure and abstractions (including SDKs and developer tooling) so product teams can reliably onboard models, measure AI quality, and ship AI-powered features. Partner with product engineering, PMs, and design while evaluating and integrating new AI advancements.
Location: New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and build abstractions and platform-level systems that improve all of Harvey’s agentic products.
  • •Own infrastructure for model integration, routing, and evaluation to choose and deploy the right foundation model per context.
  • •Build evaluation frameworks and tooling so teams can iterate on AI quality effectively.
  • •Partner closely with product engineering teams, PMs, and design to launch AI products.
  • •Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge.

Pay and Benefits

Salary: USD 231,000 - 340,000 annually
Equity and Bonus:Equity

Key Requirements

  • •8+ years building backend systems, including at least 1+ year focused on AI/ML engineering and technical leadership across teams.
  • •Experience building and shipping multi-model or multi-provider AI systems in production.
  • •Familiarity with context management, session state, or memory systems in AI or distributed systems.
  • •Track record building internal platforms, SDKs, or shared infrastructure adopted by other teams, with strong developer-experience thinking.
  • •Strong judgment about abstractions and pragmatic ability to ship incrementally (agentic AI reliability mindset).
Experience:8+ yearsAIAI/ML
Skills:Technical leadershipGood judgmentPragmatic executionOwnershipCollaboration

Company Brief

Harvey
Harvey builds domain-specific generative AI for legal and professional services, automating contract analysis, due diligence, compliance, and litigation workflows for law firms and corporate legal teams.
Industry: LegalTech
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor