Software Engineer, Platform

People Culture Talent
San Francisco
Workplace: OnsiteFull timeUSD 200,000 - 350,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["Hands-on","Ownership","Technical leadership","Adaptability","Fast-moving environment"]

Build and scale backend platform services for an AI gateway that unifies access to multiple model providers. Evolve a prototype into a reliable, independently scalable service while solving streaming challenges (SSE responses, partial failures, mid-stream fallback, and response normalization). Ship platform infrastructure like authentication, rate limiting, usage metering, and cost tracking, and add deep observability with tracing and dashboards. Help integrate eval data and contribute across platform and product.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
People Culture Talent
People Culture Talent
1 day ago

Software Engineer, Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Build and scale backend platform services for an AI gateway that unifies access to multiple model providers. Evolve a prototype into a reliable, independently scalable service while solving streaming challenges (SSE responses, partial failures, mid-stream fallback, and response normalization). Ship platform infrastructure like authentication, rate limiting, usage metering, and cost tracking, and add deep observability with tracing and dashboards. Help integrate eval data and contribute across platform and product.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Build and scale backend platform services for the AI gateway, evolving an existing prototype into an independently scalable service.
  • •Solve streaming challenges by handling SSE responses across heterogeneous providers with partial failure recovery, mid-stream fallback, and consistent response normalization.
  • •Ship platform infrastructure including authentication, rate limiting, usage metering, and cost tracking as the gateway matures.
  • •Add deep observability using distributed tracing, latency breakdowns, usage tracking, and real-time dashboards.
  • •Integrate with the evaluation platform and data, collaborating with research and product teams; contribute to backend components of Leaderboards and Evals as needed.

Pay and Benefits

Salary: USD 200,000 - 350,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVision

Key Requirements

  • •5+ years of professional software engineering experience focused on backend services, distributed systems, or developer-facing platforms.
  • •Strong Golang experience building and operating production backend systems.
  • •Experience designing reliable APIs and service integrations, including gateway/proxy-style systems.
  • •Comfort working hands-on in a fast-moving environment where platform and product evolve.
  • •Able to work from the San Francisco office three days per week.
Experience:5+ yearsDeveloper toolsDistributed systemsAI infrastructure
Skills:Hands-onOwnershipTechnical leadershipAdaptabilityFast-moving environment
Tech Stack:GolangSSEAPI gatewayAuthenticationRate limitingUsage meteringCost trackingDistributed tracingDashboardsGCPAWSAzureKubernetesTerraformPostgresRedisLLM APIsModel servingEvaluation platforms

Eligibility

Work Authorization:Sponsorship available.

Company Brief

People Culture Talent
Provides people, culture, and talent consultancy services to VCs and venture-backed startups, building people operations, talent acquisition, and culture programs to support growth from pre-seed to IPO.
Industry: Consulting
Company Size: Micro (1 to 10 employees)
Growth: Early Stage Startup
Funding: Seed
Headquarters: San Francisco, United States
Founded: 2023
WebsiteLinkedIn