Software Engineer - Testing Frameworks

Baseten
San Francisco, Toronto, New York, Montreal
Workplace: HybridFull timeUSD 165,000 - 330,000 annuallyFunction: Software EngineeringSkills: ["Independent","Mentoring","Collaboration","Problem-solving","Advocacy"]

Own the end-to-end testing strategy for a platform that powers mission-critical AI inference. Build and maintain unit, integration, load, and performance testing frameworks, plus resilient chaos testing that simulates failures and validates graceful recovery. Create infrastructure for ephemeral, realistic environments (e.g., Kubernetes namespaces and containerized dependencies), improve CI speed and determinism, and add observability and templates so new services ship with robust testing.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
1 day ago

Software Engineer - Testing Frameworks

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Own the end-to-end testing strategy for a platform that powers mission-critical AI inference. Build and maintain unit, integration, load, and performance testing frameworks, plus resilient chaos testing that simulates failures and validates graceful recovery. Create infrastructure for ephemeral, realistic environments (e.g., Kubernetes namespaces and containerized dependencies), improve CI speed and determinism, and add observability and templates so new services ship with robust testing.
Location: San Francisco, Toronto, New York, Montreal
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Own Baseten’s testing strategy end to end, defining standards, tiers, and the tooling engineering teams build against.
  • •Build and maintain unit, integration, load, and performance testing frameworks.
  • •Design test infrastructure that provisions realistic dependencies on demand, including ephemeral Kubernetes namespaces and containerized services.
  • •Build resilience and chaos testing capabilities (fault injection, network partition/latency simulation, pod/node failure scenarios, and verification of graceful degradation and recovery).
  • •Improve testing reliability and efficiency via flake detection/quarantine, test impact analysis with selective execution, parallelization, and reduced CI wall time.

Pay and Benefits

Salary: USD 165,000 - 330,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVisionPaid LeaveParental LeaveFertility Stipend401k

Key Requirements

  • •Strong proficiency in Go and/or Python with hands-on experience building test tooling and libraries used by other engineers.
  • •Deep experience with testing frameworks’ internals and the ability to extend them (e.g., pytest, Go’s testing package, testify, testcontainers).
  • •Experience designing integration test infrastructure for distributed systems, including ephemeral environment provisioning and dependency management.
  • •Practical experience with load and performance testing tools (e.g., k6, Locust, Vegeta, JMeter, Gatling) and the judgment to interpret results.
  • •Solid Kubernetes and Docker fundamentals plus advanced understanding of CI/CD for fast, deterministic, trustworthy suites at scale.
Experience:AIML startupsDeveloper toolsInfrastructureKubernetesCloud
Skills:IndependentMentoringCollaborationProblem-solvingAdvocacy
Tech Stack:GoPythonPytestTestcontainersGo testing packageTestifyK6LocustVegetaJMeterGatlingKubernetesDockerCI/CDEphemeral environments

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor