Agent Reliability Engineer, GTM

LangChain
San Francisco, California
Workplace: OnsiteFull timeUSD 150,000 - 190,000 annuallyFunction: Data Analytics & Business IntelligenceSkills: ["Clear writing","Metrics skepticism","High agency","Initiative","Cross-functional collaboration"]

Own the production health, performance, and cost impact of the GTM agent, and build the feedback loops that keep it improving. Monitor graphs for errors, slow runs, and silent failures; triage and fix issues; run a weekly eval suite and convert failures into regression tests. Track usage and business metrics, and design monitoring/alerting for LangSmith while writing an internal “how we run our own agent” reference story.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
LangChain
LangChain
2 days ago

Agent Reliability Engineer, GTM

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 57 minutes agoStatus: Live

Job Summary

Own the production health, performance, and cost impact of the GTM agent, and build the feedback loops that keep it improving. Monitor graphs for errors, slow runs, and silent failures; triage and fix issues; run a weekly eval suite and convert failures into regression tests. Track usage and business metrics, and design monitoring/alerting for LangSmith while writing an internal “how we run our own agent” reference story.
Location: San Francisco, California
Workplace: Onsite
Employment Type: Full time
Job Function: Data Analytics & Business Intelligence

Key Responsibilities

  • •Monitor production health across every graph to catch errors, slow runs, expensive runs, and silent failures.
  • •Triage incoming issues from Slack, tickets, and rep reports; fix small items and route larger issues.
  • •Run the weekly eval suite, investigate failures, and turn production bugs into regression tests.
  • •Track cost and latency by model, graph, use case, and role, recommending changes to model choice, reasoning effort, and caching.
  • •Build monitoring/alerting on LangSmith and create the “how we run our own agent” customer story, plus weekly health and business metrics reporting.

Pay and Benefits

Salary: USD 150,000 - 190,000 annually
Perks:Health InsuranceDentalVision401kPaid Leave

Key Requirements

  • •Strong production Python and SQL skills, comfortable working in traces, logs, and warehouse tables.
  • •Real experience running LLM applications, including tracing, evals, and prompt and cache mechanics.
  • •SRE/production operations instincts with percentiles and SLOs, separating noise from real patterns.
  • •Healthy skepticism about metrics, verifying what numbers actually represent.
  • •Clear writing skills and interest in publishing what you learn.
Experience:LLM applicationsSREProduction operationsTracingEvaluations
Skills:Clear writingMetrics skepticismHigh agencyInitiativeCross-functional collaboration
Tech Stack:Python 3.11FastAPILangGraphDeepAgentsLangSmithSupabase PostgresPostgresBigQueryAnthropicOpenAISlackNext.jsSQLTracingLogsCachingEval suiteSLOsPercentiles

Company Brief

LangChain
Provides an open-source framework and commercial platform (LangSmith/LangGraph) for building, testing, monitoring, and deploying LLM-powered applications and agentic AI for developers and enterprises.
Industry: Developer Tools
Company Size: Medium (51 to 250 employees)
Revenue: USD 10M to 25M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series B
Headquarters: San Francisco, United States
Founded: 2022
WebsiteLinkedIn