Infrastructure Ops Engineer

Baseten
San Francisco
Workplace: HybridFull timeUSD 120,000 - 160,000 annuallyFunction: Software EngineeringExperience: 2+ yearsEducation: bachelorsSkills: ["Communication","Ownership","Attention to detail","Problem-solving","Cross-functional collaboration"]

Operationally, this role is the engine for Baseten’s global infrastructure, bridging technical customer success and infrastructure engineering. You’ll manage GPU fleet operations, coordinate capacity needs with Sales, drive observability improvements, and orchestrate maintenance with SRE/Infra teams to keep the platform reliable and scalable for AI deployments.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
4 months ago

Infrastructure Ops Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Operationally, this role is the engine for Baseten’s global infrastructure, bridging technical customer success and infrastructure engineering. You’ll manage GPU fleet operations, coordinate capacity needs with Sales, drive observability improvements, and orchestrate maintenance with SRE/Infra teams to keep the platform reliable and scalable for AI deployments.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Fleet Maintenance: Manage daily node operations including tainting/untainting, node draining, and PVC repairs to ensure GPU fleet health and operational cost control
  • •GTM & Capacity Fulfillment: Partner with Sales and account teams to scope and fulfill customer capacity requests, translating complex timelines into concrete infrastructure actions and clear ETAs
  • •Process & Observability Engineering: Identify recurring gaps in the capacity lifecycle (intake, triage, comms) and drive fixes by defining lightweight processes and improving system observability
  • •Technical Orchestration: Act as the operational bridge between SRE and Infra teams, executing discrete changes and verifying system status during high-stakes maintenance windows
  • •Automation & Tooling: Identify repetitive workflows and partner with engineering to build scripts, dashboards, and internal tools that reduce manual intervention and shorten time-to-mitigation

Pay and Benefits

Salary: USD 120,000 - 160,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kEquity

Key Requirements

  • •Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • •2+ years of professional work experience, ideally in a customer-facing technical role or as a junior SRE/Cloud Engineer
  • •Strong familiarity with Kubernetes and the lifecycle of cloud-based container orchestration
  • •Strong ownership mindset and attention to detail, demonstrated through fast detection, clear communication, and reliable follow-through
  • •Demonstrated ability to communicate complex technical blockers clearly to both internal engineering teams and external vendors
Experience:2+ yearsAICloud infrastructureSRE
Education:Bachelor's
Skills:CommunicationOwnershipAttention to detailProblem-solvingCross-functional collaboration
Tech Stack:KubernetesCloud-nativeGPUPVCSRE

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor