Technical Program Manager, Model Performance

Baseten
San Francisco, Toronto, New York, Montreal
Workplace: HybridFull timeUSD 165,000 - 330,000 annuallyFunction: Program & Project Management (PMO)Skills: ["Cross-functional alignment","Influencing without authority","Communication","Ownership","Risk management"]

Own end-to-end execution for Baseten’s Model Performance organization, building the planning and operating cadences from scratch for a zero-to-one team. Coordinate model release and optimization programs across performance engineering, infrastructure, and release stakeholders, ensuring clear status, risk management, and cross-team alignment as scope expands into model APIs and the inference production stack. Drive predictable, well-governed programs for loosely defined initiatives.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
2 days ago

Technical Program Manager, Model Performance

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 hours agoStatus: Live

Job Summary

Own end-to-end execution for Baseten’s Model Performance organization, building the planning and operating cadences from scratch for a zero-to-one team. Coordinate model release and optimization programs across performance engineering, infrastructure, and release stakeholders, ensuring clear status, risk management, and cross-team alignment as scope expands into model APIs and the inference production stack. Drive predictable, well-governed programs for loosely defined initiatives.
Location: San Francisco, Toronto, New York, Montreal
Workplace: Hybrid
Employment Type: Full time
Job Function: Program & Project Management (PMO)

Key Responsibilities

  • •Own execution across the Model Performance active project portfolio, freeing technical leads to focus on technical direction.
  • •Design and stand up planning structures, operating cadences, and status reporting mechanisms for the team.
  • •Coordinate model release and optimization programs end to end, including day-zero launches and sequencing across stakeholders.
  • •Drive cross-team alignment as the org expands from Model Performance Core into Model APIs and the inference production stack (BIS).
  • •Surface risks and dependencies early and keep leadership informed with clear, honest status.

Pay and Benefits

Salary: USD 165,000 - 330,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVisionPaid LeavePaid Parental401kFertility Stipend

Key Requirements

  • •Deep technical program management experience running programs at the organization scope level.
  • •Experience program-managing model performance or inference optimization work.
  • •Understanding of production inference/serving stacks and tools (e.g., vLLM, TensorRT-LLM, SGLang, NVIDIA Dynamo).
  • •Comfort operating in ambiguity and building zero-to-one programs from scratch.
  • •Ability to influence without authority and communicate technical program status clearly to any audience.
Experience:Inference optimizationMachine learningAI startups
Skills:Cross-functional alignmentInfluencing without authorityCommunicationOwnershipRisk management
Tech Stack:VLLMTensorRT-LLMSGLangNVIDIA Dynamo

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor