Engineering Manager, Runtime Fabric

Baseten
San Francisco
Workplace: HybridFull timeUSD 165,000 - 330,000 annuallyFunction: Software EngineeringSkills: ["Communication","Leadership","Problem-solving","Team management"]

Lead Baseten's Runtime Fabrics team, shaping the container runtime and storage infrastructure for AI inference at scale. Set technical direction, grow a high-performance systems team, and own end-to-end performance and GPU-aware isolation. Collaborate with product and open-source communities to influence container ecosystems while delivering reliable, multi-tenant AI serving at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
2 months ago

Engineering Manager, Runtime Fabric

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 9 hours agoStatus: Live

Job Summary

Lead Baseten's Runtime Fabrics team, shaping the container runtime and storage infrastructure for AI inference at scale. Set technical direction, grow a high-performance systems team, and own end-to-end performance and GPU-aware isolation. Collaborate with product and open-source communities to influence container ecosystems while delivering reliable, multi-tenant AI serving at scale.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Manager level

Key Responsibilities

  • •Recruit, hire, and develop a high-performing team of systems engineers with deep container and Linux expertise.
  • •Foster a culture of technical rigor, open-source contribution, and continuous improvement.
  • •Provide regular coaching, feedback, and career development support to your direct reports.
  • •Partner with engineering leadership to define the long-term vision and roadmap for container runtime and storage infrastructure.
  • •Guide the team in extending and hardening containerd, runc, and related OCI ecosystem projects to meet GPU-specific requirements of production AI inference, including startup performance, GPU device access, and multi-tenant isolation.

Pay and Benefits

Salary: USD 165,000 - 330,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kEquityRemote WorkLearning Budget

Key Requirements

  • •Proven experience managing and growing engineering teams in a systems, infrastructure, or low-level runtime context.
  • •Deep familiarity with the Linux container ecosystem: containerd, runc, OCI Runtime Spec, Linux namespaces, and cgroups, with the ability to engage credibly in code reviews and architectural discussions.
  • •Contributions to containerd/containerd, opencontainers/runc, google/gvisor, kata-containers/kata-containers, or closely related open-source projects.
  • •Strong systems programming background in Go and/or C/C++.
  • •Experience with distributed storage systems, content-addressable storage, or large-scale caching infrastructure.
Experience:ContainersInfrastructureSystems programmingOpen source
Skills:CommunicationLeadershipProblem-solvingTeam management
Languages:English
Tech Stack:ContainerdRuncOCI Runtime SpecGoC/C++Linux namespacesCgroupsGPUNVIDIA Container Toolkit

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor