Senior Systems Engineer, AI Gateway

Cloudflare
Austin, San Francisco
Workplace: OnsiteFull timeUSD 194,000 - 266,000 annuallyFunction: IT Operations (Systems/Network Admin)Experience: 5+ yearsSkills: ["Technical communication","Developer experience focus","Operational judgment","Mentoring through design/code review","Iterative builder mindset"]

Build and operate Cloudflare’s AI Gateway at the network edge to support high-volume AI inference across providers and models. Design reliable routing, observability, controls, and developer workflows so AI applications can be adopted with a single API change. Prototype and ship production improvements across distributed systems and high-throughput APIs, while improving reliability, performance, cost efficiency, and debuggability for latency-sensitive workloads.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Cloudflare
Cloudflare
1 month ago

Senior Systems Engineer, AI Gateway

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and operate Cloudflare’s AI Gateway at the network edge to support high-volume AI inference across providers and models. Design reliable routing, observability, controls, and developer workflows so AI applications can be adopted with a single API change. Prototype and ship production improvements across distributed systems and high-throughput APIs, while improving reliability, performance, cost efficiency, and debuggability for latency-sensitive workloads.
Location: Austin, San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: IT Operations (Systems/Network Admin)
Seniority: Mid level

Key Responsibilities

  • •Build core AI Gateway systems to handle high-volume inference traffic across providers, models, and Cloudflare’s global network.
  • •Design and implement AI Gateway APIs, routing primitives, observability features, controls, and developer workflows for reliability and adoption.
  • •Partner across product and infrastructure boundaries with Workers AI, Agents, and the Developer Platform organization to unify the AI platform.
  • •Turn ambiguous product/technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
  • •Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.

Pay and Benefits

Salary: USD 194,000 - 266,000 annually
Perks:Health InsuranceDentalVision401kEquityPaid LeaveParental Leave

Key Requirements

  • •5+ years building and operating production systems, ideally in AI infrastructure, developer platforms, cloud/edge or high-scale/distributed systems.
  • •Strong systems engineering fundamentals across networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
  • •Experience designing/scaling distributed systems where latency, throughput, availability, and correctness matter.
  • •Comfort working across the stack, from API/product surfaces to backend services, queues/storage, control planes, or performance-critical code.
  • •Strong developer tools and technical communication through design docs, tradeoff explanations, and architecture reviews.
Experience:5+ yearsAI infrastructureDeveloper platformsCloud infrastructureEdge/proxy systemsDistributed systemsHigh-scale APIs
Skills:Technical communicationDeveloper experience focusOperational judgmentMentoring through design/code reviewIterative builder mindset
Tech Stack:AI GatewayWorkers AIAgentsAPISDKsCLIsDashboardsTypeScriptGoRustDistributed systemsRoutingObservabilityProxyEdgeGatewayTraffic managementLLM-powered applications

Company Brief

Cloudflare
Provides a global network and cloud platform that delivers security, performance, and reliability services for web applications, APIs, and Internet properties, including CDN, DDoS protection, DNS, and zero-trust security solutions.
Industry: Cybersecurity
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: San Francisco, United States
Founded: 2009
WebsiteLinkedIn