Senior Software Engineer, Inference

AssemblyAI
Toronto
Workplace: RemoteFull timeUSD 190,000 - 225,000 annuallyFunction: Software EngineeringSkills: ["Collaboration","Operating with ambiguity"]

Build and ship customer-facing APIs that expose new AI model capabilities, taking features from prototype through launch and continuous iteration. Scale inference infrastructure to support production traffic for 1M+ API users, and partner with researchers to productionize new techniques with the latency and reliability customers expect. Collaborate with Applied teams and customers to understand usage and inform product direction, contributing across backend services, inference infrastructure, SDKs, and tooling.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
AssemblyAI
AssemblyAI
5 days ago

Senior Software Engineer, Inference

âś“ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and ship customer-facing APIs that expose new AI model capabilities, taking features from prototype through launch and continuous iteration. Scale inference infrastructure to support production traffic for 1M+ API users, and partner with researchers to productionize new techniques with the latency and reliability customers expect. Collaborate with Applied teams and customers to understand usage and inform product direction, contributing across backend services, inference infrastructure, SDKs, and tooling.
Location: Toronto
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and ship customer-facing APIs that expose new model capabilities, owning them from prototype through launch and iteration.
  • •Scale inference infrastructure to support 1M+ API users.
  • •Partner with researchers to productionize new techniques into reliable, low-latency capabilities.
  • •Work with customers and Applied teams to understand how users build with the products and feed insights back into product design and research.
  • •Contribute across the stack as needed, including backend services, inference infrastructure, SDKs, and internal tooling.

Pay and Benefits

Salary: USD 190,000 - 225,000 annually

Key Requirements

  • •Strong backend engineering experience building and supporting machine learning infrastructure and/or customer-facing APIs in production.
  • •Comfort operating with ambiguity when research and product timelines don’t align.
  • •Genuine curiosity about AI/ML to make sound engineering decisions based on model behavior.
  • •Strong collaboration skills working daily with researchers, applied engineers, and sometimes customers.
Experience:AI/MLMachine learning infrastructureVoice AI
Skills:CollaborationOperating with ambiguity
Languages:English
Tech Stack:APIsBackend servicesInference infrastructureSDKsInternal tooling

Company Brief

AssemblyAI
Builds developer-focused speech-to-text and audio intelligence APIs using deep learning. Offers transcription, speaker diarization, content moderation, sentiment and intent analysis, and other audio understanding tools for enterprises and developers to integrate voice capabilities.
Industry: API Platforms
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2017
WebsiteLinkedIn