Software Engineer - Training Product

Baseten
San Francisco, New York
Workplace: OnsiteFull timeUSD 200,000 - 275,000 annuallyFunction: Education & TrainingExperience: 5+ yearsSkills: ["Communication","Ownership","Problem-solving","Collaboration","Customer focus"]

Senior Product Engineer responsible for building and shipping training platform features across API, backend, and infra layers. You’ll own multi-node training, serverless RL concepts, and collaborate with researchers to optimize training workflows, contributing to the product that accelerates model development and enables post-training workflows. The role blends software engineering with ML infrastructure, delivering MVP to GA while driving reliability and user impact.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
7 months ago

Software Engineer - Training Product

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Senior Product Engineer responsible for building and shipping training platform features across API, backend, and infra layers. You’ll own multi-node training, serverless RL concepts, and collaborate with researchers to optimize training workflows, contributing to the product that accelerates model development and enables post-training workflows. The role blends software engineering with ML infrastructure, delivering MVP to GA while driving reliability and user impact.
Location: San Francisco, New York
Workplace: Onsite
Employment Type: Full time
Job Function: Education & Training
Seniority: Sr. Manager level

Key Responsibilities

  • •Iterate like crazy
  • •Design ergonomic APIs and abstractions to model complex resources and lifecycles
  • •Work throughout the stack (API layer, backend and database implementation, infra layer; frontend is a plus) to implement features.
  • •Fine-tune and deploy models to develop intuition around training workflows.
  • •Partner closely with model developers and world-class research engineers to understand the requirements and pain points of post-training workflows.

Pay and Benefits

Salary: USD 200,000 - 275,000 annually
Equity and Bonus:Equity
Perks:MedicalDentalVision401kEquityPaid Leave

Key Requirements

  • •5+ years experience building software applications
  • •Deep knowledge of the web stack, databases, and distributed systems
  • •Experience developing developer tooling or infrastructure products for external or internal users
  • •Good taste in product, particularly developer-oriented tools
  • •Interest in ML/AI infrastructure and willingness to learn
Experience:5+ yearsAIInfrastructureML
Skills:CommunicationOwnershipProblem-solvingCollaborationCustomer focus
Tech Stack:PyTorchNCCLDeepSpeedKubernetesDocker

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor