Cloudflare

1 day ago

Senior Systems Engineer, AI Gateway

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 23 hours agoStatus: Live

Job Summary

Build and operate Cloudflare’s AI Gateway at the network edge to support high-volume AI inference across providers and models. Design reliable routing, observability, controls, and developer workflows so AI applications can be adopted with a single API change. Prototype and ship production improvements across distributed systems and high-throughput APIs, while improving reliability, performance, cost efficiency, and debuggability for latency-sensitive workloads.

Location: Austin, San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: IT Operations (Systems/Network Admin)

Seniority: Mid level

Key Responsibilities

•Build core AI Gateway systems to handle high-volume inference traffic across providers, models, and Cloudflare’s global network.
•Design and implement AI Gateway APIs, routing primitives, observability features, controls, and developer workflows for reliability and adoption.
•Partner across product and infrastructure boundaries with Workers AI, Agents, and the Developer Platform organization to unify the AI platform.
•Turn ambiguous product/technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
•Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.

Pay and Benefits

Salary: USD 194,000 - 266,000 annually

Perks:Health InsuranceDentalVision401kEquityPaid LeaveParental Leave

Key Requirements

•5+ years building and operating production systems, ideally in AI infrastructure, developer platforms, cloud/edge or high-scale/distributed systems.
•Strong systems engineering fundamentals across networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
•Experience designing/scaling distributed systems where latency, throughput, availability, and correctness matter.
•Comfort working across the stack, from API/product surfaces to backend services, queues/storage, control planes, or performance-critical code.
•Strong developer tools and technical communication through design docs, tradeoff explanations, and architecture reviews.

Experience:5+ yearsAI infrastructureDeveloper platformsCloud infrastructureEdge/proxy systemsDistributed systemsHigh-scale APIs

Skills:Technical communicationDeveloper experience focusOperational judgmentMentoring through design/code reviewIterative builder mindset

Tech Stack:AI GatewayWorkers AIAgentsAPISDKsCLIsDashboardsTypeScriptGoRustDistributed systemsRoutingObservabilityProxyEdgeGatewayTraffic managementLLM-powered applications

Company Brief

Cloudflare

Provides a global network and cloud platform that delivers security, performance, and reliability services for web applications, APIs, and Internet properties, including CDN, DDoS protection, DNS, and zero-trust security solutions.

Industry: Cybersecurity

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 2009

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Cloudflare

1 day ago

Senior Systems Engineer, AI Gateway

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 23 hours agoStatus: Live

Job Summary

Location: Austin, San Francisco

Workplace: Onsite

Employment Type: Full time

Job Function: IT Operations (Systems/Network Admin)

Seniority: Mid level

Key Responsibilities

•Build core AI Gateway systems to handle high-volume inference traffic across providers, models, and Cloudflare’s global network.
•Design and implement AI Gateway APIs, routing primitives, observability features, controls, and developer workflows for reliability and adoption.
•Partner across product and infrastructure boundaries with Workers AI, Agents, and the Developer Platform organization to unify the AI platform.
•Turn ambiguous product/technical ideas into prototypes, design docs, shipped features, and measurable production improvements.
•Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.

Pay and Benefits

Salary: USD 194,000 - 266,000 annually

Perks:Health InsuranceDentalVision401kEquityPaid LeaveParental Leave

Key Requirements

•5+ years building and operating production systems, ideally in AI infrastructure, developer platforms, cloud/edge or high-scale/distributed systems.
•Strong systems engineering fundamentals across networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
•Experience designing/scaling distributed systems where latency, throughput, availability, and correctness matter.
•Comfort working across the stack, from API/product surfaces to backend services, queues/storage, control planes, or performance-critical code.
•Strong developer tools and technical communication through design docs, tradeoff explanations, and architecture reviews.

Experience:5+ yearsAI infrastructureDeveloper platformsCloud infrastructureEdge/proxy systemsDistributed systemsHigh-scale APIs

Skills:Technical communicationDeveloper experience focusOperational judgmentMentoring through design/code reviewIterative builder mindset

Tech Stack:AI GatewayWorkers AIAgentsAPISDKsCLIsDashboardsTypeScriptGoRustDistributed systemsRoutingObservabilityProxyEdgeGatewayTraffic managementLLM-powered applications

Company Brief

Cloudflare

Industry: Cybersecurity

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: San Francisco, United States

Founded: 2009

Website LinkedIn