Staff Software Engineer, Agents

Harvey
New York
Workplace: HybridFull timeUSD 231,000 - 340,000 annuallyFunction: Software EngineeringExperience: 5-8 yearsSkills: ["Iterative mindset","Adaptability","Ownership","Quality-focused","Customer collaboration"]

Build the systems behind AI agents for legal professionals—designing environments and actions, managing context windows, selecting models, and creating tools and evaluation harnesses that speed iteration. Partner with customers and PMs to understand legal workflows, optimize agent performance via prompt/model/tool strategies, and work with model infrastructure to deliver low-latency execution. Improve observability to profile behavior, spot bottlenecks, and incorporate new agentic system advancements.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Harvey
Harvey
1 month ago

Staff Software Engineer, Agents

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live
Reposted: similar role first listed 4 months ago

Job Summary

Build the systems behind AI agents for legal professionals—designing environments and actions, managing context windows, selecting models, and creating tools and evaluation harnesses that speed iteration. Partner with customers and PMs to understand legal workflows, optimize agent performance via prompt/model/tool strategies, and work with model infrastructure to deliver low-latency execution. Improve observability to profile behavior, spot bottlenecks, and incorporate new agentic system advancements.
Location: New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Partner with customers and PMs to understand legal workflows and ship agents that get the job done.
  • •Optimize agent performance using prompt engineering, model selection, tool design, skill writing, and context window management.
  • •Develop eval harnesses and practical evaluations that define what “excellent” means.
  • •Implement low-latency agent execution infrastructure with caching, parallel tool calls, or subagent patterns.
  • •Improve observability and instrumentation to profile agent behavior and identify bottlenecks for optimization decisions.

Pay and Benefits

Salary: USD 231,000 - 340,000 annually
Equity and Bonus:Equity
Perks:EquityAnnual Bonus

Key Requirements

  • •5-8 years of post-BS/MS software engineering experience.
  • •Proficiency in Python with experience working with LLM APIs and agent frameworks.
  • •Experience shipping user-facing products, either on the backend or full-stack.
  • •Comfortable using evaluations to drive quality and iterating toward proof of concepts and v0s quickly.
  • •Passion for building effective domain-specific agents and an adaptive mindset toward code and frameworks.
Experience:5-8 yearsLegal workflowsAI agentsLLM APIsAgent frameworksProfessional services
Skills:Iterative mindsetAdaptabilityOwnershipQuality-focusedCustomer collaboration
Tech Stack:PythonLLM APIsAgent frameworks

Company Brief

Harvey
Harvey builds domain-specific generative AI for legal and professional services, automating contract analysis, due diligence, compliance, and litigation workflows for law firms and corporate legal teams.
Industry: LegalTech
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor