Software Engineer, AI Gateway

Vercel
San Francisco, New York
Workplace: HybridFull timeUSD 196,000 - 294,000 annuallyFunction: Software EngineeringExperience: 5+ yearsSkills: ["JavaScript","TypeScript","APIs","Open Source","Distributed systems","Cloud","AI","ML","Open source"]

Join the AI Gateway team to design, implement, and maintain a unified API that accesses hundreds of AI models from multiple providers. Work on low-latency, reliable systems with rate limiting and intelligent failovers, collaborating with product, research, and infra teams to integrate new providers and deliver provider-agnostic analytics and authentication. Emphasis on production-ready reliability for AI workloads and open-source engagement.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Vercel
Vercel
6 months ago

Software Engineer, AI Gateway

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 17 hours agoStatus: Live

Job Summary

Join the AI Gateway team to design, implement, and maintain a unified API that accesses hundreds of AI models from multiple providers. Work on low-latency, reliable systems with rate limiting and intelligent failovers, collaborating with product, research, and infra teams to integrate new providers and deliver provider-agnostic analytics and authentication. Emphasis on production-ready reliability for AI workloads and open-source engagement.
Location: San Francisco, New York
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
  • •Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
  • •Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
  • •Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
  • •Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

Pay and Benefits

Salary: USD 196,000 - 294,000 annually
Equity and Bonus:Equity
Perks:EquityHealth InsuranceLearning BudgetRemote WorkTime Off

Key Requirements

  • •At least 5+ years of relevant experience
  • •Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
  • •Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
  • •Experience contributing to or participating in open source projects
  • •Excellent communication skills and the ability to work effectively in a collaborative team environment
Experience:5+ yearsAI/ML integrationsDistributed systemsAPIsCloud infrastructureOpen source
Skills:JavaScriptTypeScriptAPIsOpen SourceDistributed systemsCloudAIMLOpen source
Languages:English
Tech Stack:JavaScriptTypeScriptAPIsCloudOpenAIAnthropicGoogleDistributed systems

Company Brief

Vercel
Provides a frontend cloud platform and developer tools (including Next.js and v0) that simplify building, deploying, and scaling web and AI-native applications for developers and enterprises.
Industry: Cloud Computing
Company Size: Large (251 to 1,000 employees)
Revenue: USD 100M to 250M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series F
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.1
WebsiteLinkedInGlassdoor