Technical Lead - GPU Infrastructure

Tether.io
Islamabad
Workplace: RemoteFull timeFunction: Administration & Executive AssistanceExperience: 8+ yearsEducation: bachelorsSkills: ["Leadership","Technical communication","Incident response","Architecture decision-making","Cross-team collaboration"]

Lead the architecture and delivery of Cosmic AC, Tether Data’s GPU compute and managed inference platform. Own end-to-end designs across a managed Slurm scheduling layer and a Kubernetes control plane, including bare-metal GPU enablement, multi-tenant isolation, and day-2 operations. Line-manage a distributed engineering team across Europe and India while serving as the primary technical interface to infrastructure partners, ensuring reliability, observability, and scalable managed inference for real workloads.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Tether.io
Tether.io
2 days ago

Technical Lead - GPU Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 14 hours agoStatus: Live

Job Summary

Lead the architecture and delivery of Cosmic AC, Tether Data’s GPU compute and managed inference platform. Own end-to-end designs across a managed Slurm scheduling layer and a Kubernetes control plane, including bare-metal GPU enablement, multi-tenant isolation, and day-2 operations. Line-manage a distributed engineering team across Europe and India while serving as the primary technical interface to infrastructure partners, ensuring reliability, observability, and scalable managed inference for real workloads.
Location: Islamabad
Workplace: Remote
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Own Cosmic AC platform architecture end to end, producing and maintaining architecture proposals and high-/low-level designs through review.
  • •Line-manage and lead a distributed team across backend, frontend, DevOps, QA, and documentation, including standards, code/design review, release gates, and one-to-ones.
  • •Design, build, and operate a managed Slurm service for research users, covering scheduling components, node onboarding/acceptance, driver/CUDA baseline and upgrades, health detection, drain/autohealing, storage visibility, and identity/isolation.
  • •Own Kubernetes control plane lifecycle and GPU enablement on partner-provided bare metal, including cluster bootstrap and day-2 operations (upgrades, backup/recovery, node replacement) with NVIDIA and network operators.
  • •Deliver managed inference at scale with multi-GPU/multi-node parallelism, autoscaling, request routing and endpoint reliability, plus observability, SLOs, and incident response.
Travel: Low travel

Key Requirements

  • •8+ years of hands-on engineering experience, including at least 3 years leading teams building and operating infrastructure platforms; Bachelor’s or Master’s degree in computer science/engineering or equivalent practical experience.
  • •Hands-on Slurm operation at scale (slurmctld/slurmdbd): partitions, QoS/priority, accounting, prolog/epilog, node health scripting, and upgrades; experience operating HPC or GPU training clusters.
  • •GPU fleet operation on bare metal: NVIDIA driver and CUDA lifecycle, Fabric Manager/NVSwitch behavior, DCGM health/utilization, MIG, and node burn-in/acceptance.
  • •Deep Linux systems knowledge for compute workloads: kernel modules/drivers, PCIe passthrough and vfio-pci, cgroups/namespaces, and performance tuning.
  • •Production Kubernetes operations beyond deployment: control plane, upgrades, CNI/CSI, operators/custom controllers, and multi-tenancy design.
Experience:8+ yearsHPCGPU computingKubernetesDistributed systems
Education:Bachelor's in computer science or engineering
Skills:LeadershipTechnical communicationIncident responseArchitecture decision-makingCross-team collaboration
Languages:English
Tech Stack:JavaScriptNode.jsReactKubernetesSlurmCUDALinuxNVIDIA GPU OperatorNetwork OperatorKubeVirtVFIOPrometheusGrafanaLokiInfiniBandNCCLRDMASR-IOVVfio-pciCgroups

Company Brief

Tether.io
Builds tools and services to help companies hire, onboard, and manage remote or distributed teams across borders, focusing on payroll, compliance, and global employment workflows.
Industry: HR Tech
Website