Staff Engineer - Machine Learning

Freshworks
San Mateo
Workplace: HybridFull timeUSD 211,000 - 261,000 annuallyFunction: Data Science & Machine LearningExperience: 6+ yearsSkills: ["Technical leadership","Mentorship","Code review","Engineering excellence"]

Lead the development of backend services for an agentic AI platform, driving reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Own high-performance APIs/SDKs, state and memory services, and agent communication protocols. Help transition to cloud-native, event-driven microservices, building workflow scheduling and long-running operations. Integrate RAG pipelines, vector databases, telemetry/evaluation (LangSmith), and ensure security, reliability, and engineering excellence.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Freshworks
Freshworks
2 months ago

Staff Engineer - Machine Learning

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 20 hours agoStatus: Live

Job Summary

Lead the development of backend services for an agentic AI platform, driving reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Own high-performance APIs/SDKs, state and memory services, and agent communication protocols. Help transition to cloud-native, event-driven microservices, building workflow scheduling and long-running operations. Integrate RAG pipelines, vector databases, telemetry/evaluation (LangSmith), and ensure security, reliability, and engineering excellence.
Location: San Mateo
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Lead agent runtime orchestration services focused on reasoning, planning, and tool invocation.
  • •Design robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows.
  • •Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents, including multi-agent communication (A2A).
  • •Drive cloud-native, event-driven backend architecture using microservices/service mesh, and implement workflow scheduling and long-running operations (Temporal/Airflow).
  • •Implement RAG pipelines and vector database integrations, add telemetry/evaluation support (LangSmith), and ensure tenant isolation, automated testing, and observability (OpenTelemetry) while mentoring engineers.

Pay and Benefits

Salary: USD 211,000 - 261,000 annually
Equity and Bonus:Equity
Perks:DentalMedicalVisionDisabilityLife InsuranceEquityEsppPaid LeaveFlexible SpendingCommuter BenefitsWellness StipendAdoption LeaveParental Leave

Key Requirements

  • •6+ years of backend engineering experience.
  • •1-2+ years of hands-on experience in AI/ML platform development.
  • •Strong programming skills in Java and Python.
  • •Hands-on experience with LangChain, LangGraph, or LangSmith.
  • •Deep understanding of event-driven architectures, microservices, and Kubernetes.
Experience:6+ yearsAI/MLSaaSStartupsDistributed systems
Skills:Technical leadershipMentorshipCode reviewEngineering excellence
Languages:English
Tech Stack:JavaPythonLangChainLangGraphLangSmithMicroservicesService meshKubernetesAWSTerraformPostgreSQLPineconeWeaviateFAISSTemporalAirflowKafkaOpenTelemetryRBACAPI authentication

Company Brief

Freshworks
Provides cloud-based customer engagement, CRM and ITSM software (Freshdesk, Freshservice, Freshsales) that helps businesses manage customer and employee experiences through SaaS products and AI-driven tools.
Industry: Enterprise Software
Company Size: Enterprise (1,001+ employees)
Revenue: USD 500M to 1B
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Mateo, United States
Founded: 2010
Glassdoor
Glassdoor: 3.5
WebsiteLinkedInGlassdoor