Staff Backend AI Platform Engineer

Freshworks
San Mateo
Workplace: HybridFull timeUSD 225,000 - 278,000 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 6+ yearsSkills: ["Technical leadership","Mentorship","Code review","High engineering standards","Collaboration"]

Lead backend engineering for an agentic AI platform, building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Own high-performance APIs and orchestration runtimes, including state and memory services, multi-agent communication protocols, and tenant isolation. Drive the shift to cloud-native, event-driven microservices and optimize LLM orchestration for performance and cost. Integrate RAG pipelines, vector databases, and LangSmith evaluation/observability, while mentoring engineers and raising engineering standards.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Freshworks
Freshworks
2 months ago

Staff Backend AI Platform Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 19 hours agoStatus: Live

Job Summary

Lead backend engineering for an agentic AI platform, building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Own high-performance APIs and orchestration runtimes, including state and memory services, multi-agent communication protocols, and tenant isolation. Drive the shift to cloud-native, event-driven microservices and optimize LLM orchestration for performance and cost. Integrate RAG pipelines, vector databases, and LangSmith evaluation/observability, while mentoring engineers and raising engineering standards.
Location: San Mateo
Workplace: Hybrid
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Lead implementation of agent runtime orchestration services, including reasoning, planning, and tool invocation.
  • •Design and develop robust APIs and SDKs for building and deploying agent workflows.
  • •Build and optimize stateful dialog management and memory services for context-aware, multi-turn agents.
  • •Implement multi-agent communication (A2A) protocols and shared context systems.
  • •Drive backend architecture and reliability: cloud-native event-driven services, workflow scheduling for long-running operations, and performance/cost optimization for LLM orchestration.

Pay and Benefits

Salary: USD 225,000 - 278,000 annually
Equity and Bonus:Equity
Perks:DentalMedicalVisionDisabilityLife InsuranceEquityEsppPaid LeaveCommuter BenefitsWellness StipendAdoption LeaveParental Leave

Key Requirements

  • •6+ years of backend engineering experience.
  • •1-2+ years of hands-on experience in AI/ML platform development.
  • •Strong programming skills in Java and Python.
  • •Hands-on experience with LangChain, LangGraph, or LangSmith.
  • •Deep understanding of event-driven architectures, microservices, and Kubernetes.
Experience:6+ yearsSaaSStartupAI/ML platformMicroservicesEvent-driven architectures
Skills:Technical leadershipMentorshipCode reviewHigh engineering standardsCollaboration
Languages:English
Tech Stack:JavaPythonLangChainLangGraphLangSmithMicroservicesService meshKubernetesAWSTerraformPostgreSQLPineconeWeaviateFAISSTemporalAirflowKafkaOpenTelemetryRBACAPI authentication

Company Brief

Freshworks
Provides cloud-based customer engagement, CRM and ITSM software (Freshdesk, Freshservice, Freshsales) that helps businesses manage customer and employee experiences through SaaS products and AI-driven tools.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Mateo, United States
Founded: 2010
Glassdoor
Glassdoor: 3.5
WebsiteLinkedInGlassdoor