Senior Software Engineer, Inference

AssemblyAI
New York, North America
Workplace: RemoteFull timeUSD 190,000 - 225,000 annuallyFunction: Software EngineeringSkills: ["Collaboration","Working with ambiguity"]

Build and ship customer-facing APIs that expose new voice AI model capabilities, taking them from prototype to production and continuous iteration. Scale inference infrastructure for high-traffic usage, and partner with researchers to productionize new techniques with production latency, reliability, and usability. Collaborate with customers and Applied teams to understand real usage patterns and feed insights back into product design and research direction across backend services, infrastructure, SDKs, and internal tooling.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
AssemblyAI
AssemblyAI
1 day ago

Senior Software Engineer, Inference

âś“ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live
Reposted: similar role first listed 5 days ago

Job Summary

Build and ship customer-facing APIs that expose new voice AI model capabilities, taking them from prototype to production and continuous iteration. Scale inference infrastructure for high-traffic usage, and partner with researchers to productionize new techniques with production latency, reliability, and usability. Collaborate with customers and Applied teams to understand real usage patterns and feed insights back into product design and research direction across backend services, infrastructure, SDKs, and internal tooling.
Location: New York, North America
Workplace: Remote
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and ship customer-facing APIs exposing new model capabilities from prototype through launch and ongoing iteration.
  • •Scale inference infrastructure to support high-volume API usage.
  • •Partner with researchers to productionize new techniques with production latency, reliability, and usability.
  • •Work with customers and Applied teams to understand how users build with the product and feed insights back into product and research direction.
  • •Contribute across the stack as needed, including backend services, inference infrastructure, SDKs, and internal tooling.

Pay and Benefits

Salary: USD 190,000 - 225,000 annually

Key Requirements

  • •Strong backend engineering experience building and supporting ML infrastructure and/or customer-facing production APIs.
  • •Comfort operating with ambiguity when research and product timelines don’t align.
  • •Genuine curiosity about AI/ML to make sound engineering decisions about model behavior.
  • •Strong collaboration skills working daily with researchers, applied engineers, and sometimes customers with differing priorities.
Experience:Machine learningVoice AIAI/ML
Skills:CollaborationWorking with ambiguity

Company Brief

AssemblyAI
Builds developer-focused speech-to-text and audio intelligence APIs using deep learning. Offers transcription, speaker diarization, content moderation, sentiment and intent analysis, and other audio understanding tools for enterprises and developers to integrate voice capabilities.
Industry: API Platforms
Company Size: Medium (51 to 250 employees)
Growth: Growth Stage Startup
Headquarters: San Francisco, United States
Founded: 2017
WebsiteLinkedIn