Technical Lead - GPU Infrastructure

Tether.io
Albania
Workplace: RemoteFull timeFunction: Administration & Executive AssistanceEducation: bachelorsSkills: ["Leadership","Written communication","Technical decision-making","Incident management","Cross-time-zone collaboration"]

Own end-to-end architecture and delivery for Cosmic AC, Tether Data’s managed GPU compute and inference platform. You’ll lead a distributed engineering team and build a full stack that starts with a managed Slurm scheduling layer and evolves into a Kubernetes control plane for inference tenancy. Drive bare-metal GPU scheduling, NVIDIA driver/CUDA lifecycle, multi-tenant isolation, autoscaling, and platform observability—while serving as the primary technical interface to infrastructure partners and internal research teams.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Tether.io
Tether.io
16 hours ago

Technical Lead - GPU Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Own end-to-end architecture and delivery for Cosmic AC, Tether Data’s managed GPU compute and inference platform. You’ll lead a distributed engineering team and build a full stack that starts with a managed Slurm scheduling layer and evolves into a Kubernetes control plane for inference tenancy. Drive bare-metal GPU scheduling, NVIDIA driver/CUDA lifecycle, multi-tenant isolation, autoscaling, and platform observability—while serving as the primary technical interface to infrastructure partners and internal research teams.
Location: Albania
Workplace: Remote
Employment Type: Full time · Permanent
Job Function: Administration & Executive Assistance
Seniority: Manager level

Key Responsibilities

  • •Own the platform architecture end to end, including architecture proposals and high-/low-level designs, and keep them current through review.
  • •Line-manage and lead a distributed engineering team (backend, frontend, DevOps, QA, documentation), setting engineering standards and leading release gates and one-to-ones.
  • •Design, build, and operate a managed Slurm scheduling layer on bare-metal GPU infrastructure for research users, including health detection, drain/autohealing, and isolation.
  • •Own Kubernetes control-plane and GPU enablement across partner-provided bare metal, including NVIDIA GPU Operator/Network Operator integration, upgrades, backup/recovery, and node replacement.
  • •Deliver managed inference at scale with autoscaling, request routing, endpoint reliability, and confidential-compute-capable capacity; run observability, on-call, incidents, and partner/vendor escalations to closure.
Travel: Low travel

Key Requirements

  • •8+ years of hands-on engineering, including at least three years leading teams that build and operate infrastructure platforms; Bachelor’s or Master’s degree in computer science/engineering or equivalent practical experience.
  • •Hands-on Slurm at scale, including operating slurmctld and slurmdbd for real users and managing partitions, QoS, accounting, prolog/epilog, and upgrades.
  • •GPU fleet operation on bare metal: NVIDIA driver and CUDA lifecycle, Fabric Manager/NVSwitch behavior on SXM systems, DCGM-based health/utilization, MIG, and node burn-in/acceptance.
  • •High-performance interconnects and ML performance debugging: InfiniBand fabric/subnet configuration, RDMA, SR-IOV, and diagnosing multi-node NCCL performance issues.
  • •Production Kubernetes operation beyond deployment: control plane, upgrades, CNI/CSI, operators/custom controllers, and multi-tenancy design.
Education:Bachelor's
Skills:LeadershipWritten communicationTechnical decision-makingIncident managementCross-time-zone collaboration
Languages:English
Tech Stack:JavaScriptNode.jsReactKubernetesSlurmSlurmctldSlurmdbdCUDANVIDIAFabric ManagerNVSwitchDCGMMIGInfiniBandNCCLRDMASR-IOVLinuxKernel modulesVfio-pci

Company Brief

Tether.io
Builds tools and services to help companies hire, onboard, and manage remote or distributed teams across borders, focusing on payroll, compliance, and global employment workflows.
Industry: HR Tech
Website