Software Engineer - AI Developer Productivity

Baseten
San Francisco, Toronto, New York, Montreal
Workplace: HybridFull timeUSD 165,000 - 330,000 annuallyFunction: Software EngineeringExperience: 4+ yearsSkills: ["Written communication","Platform mindset","Comfort with ambiguity","Developer experience focus","Adoption orientation"]

Build Baseten’s internal AI developer platform that makes the “golden path” for agents the easy path. You’ll design repo-level context infrastructure, internal MCP services, and onboarding/templates so new engineers are productive quickly. Own the evaluation practice that compares agent configurations on real tasks, instrument AI tool usage, integrate agents into CI/CD with guardrails, and create self-serve frameworks for teams—while ensuring safety, permissions, secrets handling, audit trails, and cost controls.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Baseten
Baseten
1 day ago

Software Engineer - AI Developer Productivity

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 8 hours agoStatus: Live

Job Summary

Build Baseten’s internal AI developer platform that makes the “golden path” for agents the easy path. You’ll design repo-level context infrastructure, internal MCP services, and onboarding/templates so new engineers are productive quickly. Own the evaluation practice that compares agent configurations on real tasks, instrument AI tool usage, integrate agents into CI/CD with guardrails, and create self-serve frameworks for teams—while ensuring safety, permissions, secrets handling, audit trails, and cost controls.
Location: San Francisco, Toronto, New York, Montreal
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Own the internal AI developer platform end to end: architecture, build, rollout, operation, and measurement.
  • •Evaluate and integrate third-party AI coding tools and build a context layer that works with the monorepo.
  • •Build agent frameworks so other engineers can create their own agents without deep LLM expertise.
  • •Establish AI evaluation practices, instrument AI tool usage, and use results to drive investment decisions.
  • •Drive adoption through developer experience and embed with teams to generalize wins into platform capabilities, including safety and cost controls.

Pay and Benefits

Salary: USD 165,000 - 330,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVisionPaid LeaveWinter BreakParental LeaveFertility Stipend401k

Key Requirements

  • •4+ years of experience building and enabling AI native SDLC.
  • •Strong proficiency in Python and/or Go for developer tooling relied on daily.
  • •Hands-on experience with LLMs and agent frameworks (tool calling, MCP, context management, orchestration, failure handling) with real usage.
  • •Deep fluency with AI coding tools and strong judgment about failure modes.
  • •Comfort with platform work in fast-changing ambiguity and strong written communication for docs, templates, and examples.
Experience:4+ yearsAI native SDLCLLMsDeveloper tooling
Skills:Written communicationPlatform mindsetComfort with ambiguityDeveloper experience focusAdoption orientation
Tech Stack:PythonGoLLMsAgent frameworksMCPTool callingCI/CDKubernetesDockerClaude CodeCursorCodex

Company Brief

Baseten
Baseten provides an inference-first ML infrastructure platform that lets engineering and ML teams deploy, serve, and scale machine-learning models with optimized performance, autoscaling, and GPU-backed hosting for production AI applications. ([crunchbase.com](https://www.crunchbase.com/organization/baseten?utm_source=openai))
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2019
Glassdoor
Glassdoor: 5.0
WebsiteLinkedInGlassdoor