Digital Ocean

2 weeks ago

Senior Software Engineer I - Serverless Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Design and build multi-tenant serverless inference infrastructure and APIs to power large-scale AI workloads. Improve reliability, availability, and performance for distributed systems handling GPU utilization and fault tolerance. Enhance platform resiliency through observability, capacity management, automation, and operational tooling, partnering with platform, GPU infrastructure, and product engineering teams. Own architecture decisions for traffic management and service orchestration, participate in on-call, and lead incident-management and continuous-improvement efforts.

Location: Bengaluru

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design and build scalable, multi-tenant services that power AI inference and intelligent routing workloads.
•Develop and operate high-scale distributed systems with reliability, availability, and performance targets.
•Strengthen platform resiliency via improved observability, capacity management, automation, and operational tooling.
•Partner with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs.
•Participate in on-call rotations and lead efforts to reduce operator pain, improve service health, and prevent recurring incidents.

Pay and Benefits

Perks:EquityFlexible TimeEapLearning Budget

Key Requirements

•4+ years building and operating multi-tenant platforms or distributed backend systems.
•Experience operating high-scale distributed services in production environments.
•Strong SRE knowledge across observability, incident management, reliability engineering, capacity planning, and operational automation.
•1+ years hands-on with Go (Golang) in production systems.
•1+ years experience with Kubernetes, plus strong understanding of cloud-native architectures and distributed systems.

Experience:4+ yearsAI workloadsMulti-tenant platformsDistributed systemsSRECloud-native architectures

Skills:Operational disciplineIncident managementContinuous improvementDebuggingCollaboration

Languages:English

Tech Stack:GoGolangKubernetesMicroservicesDistributed systemsGPU utilizationObservabilityTime To First Token (TTFT)Time Per Output Token (TPOT)VLLMTritonTensorRT-LLMAPI gatewaysTraffic routingService mesh

Company Brief

Digital Ocean

Provides cloud infrastructure and developer-focused cloud services including scalable droplets, managed databases, Kubernetes, object storage, and networking to simplify deploying and managing applications for developers and small-to-medium businesses.

Industry: Cloud Computing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 250M to 500M

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: New York, United States

Founded: 2011

Glassdoor: 3.8

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

Digital Ocean

2 weeks ago

Senior Software Engineer I - Serverless Inference

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Location: Bengaluru

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design and build scalable, multi-tenant services that power AI inference and intelligent routing workloads.
•Develop and operate high-scale distributed systems with reliability, availability, and performance targets.
•Strengthen platform resiliency via improved observability, capacity management, automation, and operational tooling.
•Partner with platform, GPU infrastructure, and product engineering teams to deliver production-grade systems and highly available APIs.
•Participate in on-call rotations and lead efforts to reduce operator pain, improve service health, and prevent recurring incidents.

Pay and Benefits

Perks:EquityFlexible TimeEapLearning Budget

Key Requirements

•4+ years building and operating multi-tenant platforms or distributed backend systems.
•Experience operating high-scale distributed services in production environments.
•Strong SRE knowledge across observability, incident management, reliability engineering, capacity planning, and operational automation.
•1+ years hands-on with Go (Golang) in production systems.
•1+ years experience with Kubernetes, plus strong understanding of cloud-native architectures and distributed systems.

Experience:4+ yearsAI workloadsMulti-tenant platformsDistributed systemsSRECloud-native architectures

Skills:Operational disciplineIncident managementContinuous improvementDebuggingCollaboration

Languages:English

Company Brief

Digital Ocean

Industry: Cloud Computing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 250M to 500M

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: New York, United States

Founded: 2011

Glassdoor: 3.8

Website LinkedIn