Member of Engineering (Inference Infrastructure)

Poolside
United Kingdom
Workplace: RemoteFull timeFunction: DevOps, Cloud & InfrastructureSkills: ["Observability","Debuggability","Troubleshooting","Collaboration"]

Build and optimize Poolside’s compute platform for GPU utilization, GPU workload scheduling, and inference serving. Partner with the inference and scalability teams to improve throughput and latency for evals and reinforcement learning, while helping stabilize fault-tolerant large-scale training. Work closely with infra to ensure GPU nodes are healthy and fully utilized, delivering a stable, scalable inference serving stack for researchers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Poolside
Poolside
2 months ago

Member of Engineering (Inference Infrastructure)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 21 hours agoStatus: Live

Job Summary

Build and optimize Poolside’s compute platform for GPU utilization, GPU workload scheduling, and inference serving. Partner with the inference and scalability teams to improve throughput and latency for evals and reinforcement learning, while helping stabilize fault-tolerant large-scale training. Work closely with infra to ensure GPU nodes are healthy and fully utilized, delivering a stable, scalable inference serving stack for researchers.
Location: United Kingdom
Workplace: Remote
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Design and develop internal scheduling systems to maximize GPU utilization.
  • •Build APIs and tooling to manage the lifecycle of GPU workloads and troubleshoot failures.
  • •Design and improve inference control planes to speed up model deployment and inference request serving.
  • •Collaborate with research to continuously improve research velocity.
  • •Partner with inference, scalability, and infra teams to improve throughput/latency and stabilize fault-tolerant training.

Pay and Benefits

Perks:Remote WorkHealth InsuranceParental LeaveHome Office

Key Requirements

  • •Strong programming skills in Go (or similar languages).
  • •Strong systems engineering background in distributed systems, schedulers, control planes, or high-throughput data planes.
  • •Production experience with Kubernetes internals (controllers, informers, operators), not just deployment.
  • •Bias toward observability and debuggability for production troubleshooting.
  • •Experience serving large-scale inference requests.
Experience:AIReinforcement learning
Skills:ObservabilityDebuggabilityTroubleshootingCollaboration
Tech Stack:GoKubernetesAPIDistributed systemsGPU

Company Brief

Poolside
Builds foundation models, coding agents, and enterprise systems to automate and accelerate software development; offers on-prem/VPC deployments, developer tooling, and forward-deployed engineering for high‑security environments.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series B
Headquarters: San Francisco, United States
Founded: 2023
WebsiteLinkedIn