Senior Software Engineer, Model Serving

Databricks
San Francisco, Mountain View
Workplace: OnsiteFull timeFunction: Software EngineeringExperience: 5+ yearsSkills: ["Communication","Leadership","Mentoring","Collaboration","Problem-solving"]

Senior Engineer role focusing on building and refining the Databricks Model Serving platform. You’ll design high-throughput, low-latency inference systems for CPU/GPU workloads, influence architecture, and collaborate with platform, product, infrastructure, and research teams to deliver a scalable, cost-efficient serving platform with strong SLAs.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Databricks
Databricks
10 months ago

Senior Software Engineer, Model Serving

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Senior Engineer role focusing on building and refining the Databricks Model Serving platform. You’ll design high-throughput, low-latency inference systems for CPU/GPU workloads, influence architecture, and collaborate with platform, product, infrastructure, and research teams to deliver a scalable, cost-efficient serving platform with strong SLAs.
Location: San Francisco, Mountain View
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Design and implement core systems and APIs that power Databricks Model Serving, ensuring scalability, reliability, and operational excellence.
  • •Drive architectural decisions and trade-offs to optimize performance, throughput, autoscaling, and operational efficiency for CPU and GPU serving workloads.
  • •Contribute directly to key components across the serving infrastructure — from model container builds and deployment workflows to runtime systems like routing, caching, observability, and intelligent autoscaling — ensuring smooth and efficient operations at scale.
  • •Collaborate cross-functionally with product, platform, and research teams to translate customer needs into reliable and performant systems.
  • •Lead technical initiatives that improve latency, availability, and cost-effectiveness across both customer-facing and foundational serving layers.

Key Requirements

  • •5+ years of experience building and operating large-scale distributed systems.
  • •Experience in model serving, inference systems, or related infrastructure (e.g., routing, scheduling, autoscaling, and observability).
  • •Strong foundation in algorithms, data structures, and system design as applied to large-scale, low-latency serving systems.
  • •Proven ability to deliver technically complex, high-impact initiatives that create measurable customer or business value.
  • •Experience building architecture for large-scale, performance-sensitive CPU/GPU inference systems.
Experience:5+ yearsAIMachine learningData analyticsCloud
Skills:CommunicationLeadershipMentoringCollaborationProblem-solving
Languages:English
Tech Stack:Distributed systemsAPIsContainerizationRoutingCachingObservabilityAutoscalingCPUGPU

Company Brief

Databricks
Provides a unified data analytics platform powered by Apache Spark to simplify building, deploying, and scaling data engineering, data science, and machine learning workloads for enterprises.
Industry: Data Infrastructure
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2013
WebsiteLinkedIn