Software Engineer - Infrastructure

Baseten
San Francisco, New York, United States, Toronto, Canada, Montreal
Workplace: OnsiteFull timeUSD 150,000 - 230,000 annuallyFunction: Software EngineeringExperience: 1-3 yearsEducation: bachelorsSkills: ["Communication","Collaboration","Problem-solving"]

Build and maintain components of a scalable ML inference platform, enabling deployment, scaling, and monitoring of AI models. Collaborate on core infrastructure, Kubernetes deployments, and resource management to balance performance with reliability in a fast-growing AI-focused environment.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
1 year ago

Software Engineer - Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 15 hours agoStatus: Live

Job Summary

Build and maintain components of a scalable ML inference platform, enabling deployment, scaling, and monitoring of AI models. Collaborate on core infrastructure, Kubernetes deployments, and resource management to balance performance with reliability in a fast-growing AI-focused environment.
Location: San Francisco, New York, United States, Toronto, Canada, Montreal
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Develop infrastructure components for our ML inference platform using Python and Go
  • •Implement and maintain Kubernetes deployments for model serving
  • •Contribute to our inference orchestration layer for model deployments
  • •Build and enhance monitoring systems for model performance metrics
  • •Implement efficient resource management solutions for ML workloads

Pay and Benefits

Salary: USD 150,000 - 230,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision401kEquity

Key Requirements

  • •Bachelor's degree or higher in Computer Science or related field
  • •1-3 years experience in software engineering or infrastructure
  • •Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus
  • •Working knowledge of Kubernetes and containerization
  • •Basic understanding of machine learning concepts and model serving
Experience:1-3 years
Education:Bachelor's in Computer Science
Skills:CommunicationCollaborationProblem-solving
Languages:English
Tech Stack:PythonGoKubernetesDockerDistributed systemsModel serving

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor