Senior Software Engineer, Backend (AI Agent Runtime)

Cresta
United States, Canada, Alberta, British Columbia, Ontario
Workplace: RemoteFull timeFunction: Software EngineeringExperience: 5+ yearsSkills: ["Communication","Problem-solving","Collaboration"]

Join Cresta as a Staff Software Engineer focused on backend AI platform development. You will design and maintain low-latency model serving stacks, automate ML pipelines on Kubernetes, optimize for scale and cost, build reusable platform primitives for research and product teams, and enhance observability and production ML practices across distributed systems.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cresta
Cresta
1 year ago

Senior Software Engineer, Backend (AI Agent Runtime)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Join Cresta as a Staff Software Engineer focused on backend AI platform development. You will design and maintain low-latency model serving stacks, automate ML pipelines on Kubernetes, optimize for scale and cost, build reusable platform primitives for research and product teams, and enhance observability and production ML practices across distributed systems.
Location: United States, Canada, Alberta, British Columbia, Ontario
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Own model serving: Design, build, and maintain low-latency, highly-available serving stacks for in-house ML model serving and integrating with LLM serving partners.
  • •Automate training pipelines: Orchestrate data prep, training, evaluation, and registry workflows on Kubernetes with solid MLOps practices.
  • •Optimize at scale: Profile and tune throughput, memory, and cost; introduce caching, sharding, batching, and GPU/CPU autoscaling where it pays off.
  • •Build platform primitives: Create reusable SDKs, templates, and CLI tools that let research and product teams ship models independently and safely.
  • •Raise the bar: Instrument deep observability (tracing, metrics, alerts), drive blameless post-mortems, and mentor engineers on production ML best practices.

Pay and Benefits

Perks:MedicalDentalVisionRemote WorkParental LeaveRetirement SavingsWellness StipendCommuter BenefitsMeal Program

Key Requirements

  • •5+ years writing production software; 2+ years focused on ML platform or infra.
  • •Expert Python (async, typing, packaging, performance).
  • •Working Golang knowledge for systems components.
  • •Proven experience with one or more serving frameworks (e.g., vLLM, Triton, TorchServe).
  • •Kubernetes and cloud-native ops.
Experience:5+ yearsAIML platformInfrastructureKubernetes
Skills:CommunicationProblem-solvingCollaboration
Languages:English
Tech Stack:PythonGolangKubernetesVLLMTritonTorchServe

Company Brief

Cresta
Builds AI-driven real-time coaching and assistance for customer-facing teams, using conversational intelligence to improve agent performance, automate workflows, and boost customer outcomes across contact centers and sales operations.
Industry: SaaS
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2017
WebsiteLinkedIn