Staff Software Engineer, Foundation Model API

Build FMAPI, the unified serving layer for large language models powering real-time and batch inference at enterprise scale. You’ll design LLM infrastructure for partner and self-hosted models, improve reliability, latency, and efficiency of distributed AI workloads, and shape the product from roadmap to execution through direct engagement with users and model providers. Work closely with platform, infra, and ML teams to deliver seamless end-to-end AI developer experiences on Databricks.