Technical Lead - GPU Infrastructure

Tether.io
Dublin
Workplace: RemoteFull timeFunction: Administration & Executive AssistanceExperience: 8+ yearsEducation: bachelorsSkills: ["Leadership","Written communication","Spoken communication","Architecture","Incident response"]

Own end-to-end architecture and delivery of a self-hosted GPU compute and managed inference platform (Cosmic AC). Lead a distributed engineering team and drive a managed Slurm scheduling layer plus a Kubernetes control plane for bare-metal NVIDIA GPU clusters. Handle GPU fleet enablement, multi-tenant inference at scale, and operational excellence with observability, SLOs, incident response, and partner/vendor escalations—staying hands-on while line-managing engineers.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Tether.io
Tether.io
1 day ago

Technical Lead - GPU Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

Own end-to-end architecture and delivery of a self-hosted GPU compute and managed inference platform (Cosmic AC). Lead a distributed engineering team and drive a managed Slurm scheduling layer plus a Kubernetes control plane for bare-metal NVIDIA GPU clusters. Handle GPU fleet enablement, multi-tenant inference at scale, and operational excellence with observability, SLOs, incident response, and partner/vendor escalations—staying hands-on while line-managing engineers.
Location: Dublin
Workplace: Remote
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Own platform architecture end to end, producing and maintaining architecture proposals and high- and low-level designs through review.
  • •Line-manage and lead a distributed engineering team (backend Node.js, frontend React, DevOps, QA, documentation) with engineering standards, code/design review, release gates, and one-to-ones.
  • •Design, build, and operate a managed Slurm scheduling layer for research users, including scheduling components, driver/CUDA baselines, health detection, drain/autohealing, storage visibility, and identity/isolation.
  • •Own Kubernetes control plane and GPU enablement on partner-provided bare metal, including cluster bootstrap/lifecycle and day-2 operations (upgrades, backup/recovery, node replacement) with GPU isolation.
  • •Deliver managed inference at scale with serving architecture, multi-GPU/multi-node parallelism, autoscaling, request routing, endpoint reliability, and observability/operations with incident response and post-incident review.
Travel: Low travel

Key Requirements

  • •8+ years of hands-on engineering, including at least three leading teams building and operating infrastructure platforms; Bachelor’s or Master’s in CS/engineering (or equivalent experience).
  • •Hands-on Slurm operations at scale (slurmctld/slurmdbd) for real users, including accounting, partitions/QoS, upgrades, and HPC/GPU training cluster experience.
  • •Bare-metal NVIDIA GPU fleet operations: driver and CUDA lifecycle, Fabric Manager/NVSwitch behaviour, DCGM health/utilisation, MIG, and node acceptance/burn-in.
  • •Deep Linux systems knowledge for compute workloads: kernel modules/drivers, PCIe passthrough/vfio-pci, cgroups/namespaces, and performance tuning.
  • •Production Kubernetes operations beyond deployment: control plane, upgrades, CNI/CSI, operators/custom controllers, plus multi-tenancy design.
Experience:8+ years
Education:Bachelor's
Skills:LeadershipWritten communicationSpoken communicationArchitectureIncident response
Languages:English
Tech Stack:KubernetesJavaScriptNode.jsReactDevOpsSlurmNVIDIACUDAInfiniBandRDMANCCLSR-IOVLinuxVfio-pciCgroupsNamespacesPrometheusGrafanaLokiSLO

Company Brief

Tether.io
Builds tools and services to help companies hire, onboard, and manage remote or distributed teams across borders, focusing on payroll, compliance, and global employment workflows.
Industry: HR Tech
Website