Technical Lead - GPU Infrastructure

Tether.io
London
Workplace: RemoteFull timeFunction: Administration & Executive AssistanceExperience: 8+ yearsEducation: bachelorsSkills: ["Leadership","Technical communication","Incident response","Cross-time-zone collaboration","Architecture decision-making"]

Own the end-to-end architecture and delivery of Cosmic AC, Tether Data’s GPU compute and managed inference platform. Lead a distributed engineering team while building a managed Slurm scheduling layer and a Kubernetes control plane for multi-tenant inference on bare-metal NVIDIA GPU infrastructure. Drive day-2 operations, upgrades, observability, incident response, partner escalations, and internal capacity planning—remaining hands-on through technical reviews and delivery plans.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Tether.io
Tether.io
1 day ago

Technical Lead - GPU Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 16 hours agoStatus: Live

Job Summary

Own the end-to-end architecture and delivery of Cosmic AC, Tether Data’s GPU compute and managed inference platform. Lead a distributed engineering team while building a managed Slurm scheduling layer and a Kubernetes control plane for multi-tenant inference on bare-metal NVIDIA GPU infrastructure. Drive day-2 operations, upgrades, observability, incident response, partner escalations, and internal capacity planning—remaining hands-on through technical reviews and delivery plans.
Location: London
Workplace: Remote
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Own the platform architecture end to end: architecture proposals plus high- and low-level designs, maintained as the baseline through review.
  • •Line-manage and lead a distributed engineering team, setting standards and running code/design review, release gates, and one-to-ones across backend, frontend, DevOps, QA, and documentation.
  • •Design, build, and operate a managed Slurm scheduling layer on bare metal for research users, including scheduling components, node onboarding/acceptance, driver/CUDA baselines, health detection, drain/autohealing, and identity/isolation.
  • •Own Kubernetes control plane and GPU enablement: cluster bootstrap/lifecycle on partner-provided bare metal, NVIDIA GPU Operator/Network Operator, GPU isolation (KubeVirt/VFIO), and day-2 ops (upgrades, backup/recovery, node replacement).
  • •Deliver managed inference at scale and ensure observability/operations: serving architecture, multi-GPU/node parallelism, autoscaling and routing reliability, SLOs, incident response, and post-incident review; serve as primary technical interface to partners.
Travel: Low travel

Key Requirements

  • •8+ years of hands-on engineering, including at least three leading teams building and operating infrastructure platforms; Bachelor’s/Master’s in CS/engineering or equivalent practical experience.
  • •Hands-on operation of Slurm at scale (slurmctld/slurmdbd) for real users: partitions, QoS/priority, accounting, prolog/epilog, node health scripting, and upgrades with running jobs.
  • •Bare-metal NVIDIA GPU fleet operations: driver and CUDA lifecycle, Fabric Manager/NVSwitch behaviour, DCGM health/utilisation, MIG, and node burn-in/acceptance.
  • •High-performance interconnect expertise: InfiniBand subnet configuration, RDMA, SR-IOV, and diagnosing multi-node NCCL performance problems.
  • •Production Kubernetes operations beyond deployment: control plane, upgrades, CNI/CSI, operators and custom controllers, plus multi-tenancy design.
Experience:8+ yearsHPCGPU infrastructureKubernetesManaged inference
Education:Bachelor's
Skills:LeadershipTechnical communicationIncident responseCross-time-zone collaborationArchitecture decision-making
Languages:English
Tech Stack:JavaScriptNode.jsReactKubernetesSlurmNVIDIACUDAFabric ManagerNVSwitchDCGMMIGInfiniBandRDMASR-IOVNCCLLinuxVfio-pciPCIe passthroughCgroupsNamespaces

Company Brief

Tether.io
Builds tools and services to help companies hire, onboard, and manage remote or distributed teams across borders, focusing on payroll, compliance, and global employment workflows.
Industry: HR Tech
Website