AI2

2 weeks ago

Senior Engineering Manager, AI Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 3 hours agoStatus: Live

Job Summary

Lead the day-to-day operations of an HPC-focused AI infrastructure, ensuring on-prem GPU clusters and the orchestration layer deliver reliable, high-throughput performance. You’ll operate and improve Beaker to schedule workloads across on-prem and hybrid cloud resources (AWS/GCP), manage storage for petascale research data, and provide technical support to research teams. Manage and grow systems engineers, SREs, and software developers while executing the roadmap with product and PM partners.

Location: Seattle

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Sr. Manager level

Key Responsibilities

•Own execution and reliability of an HPC environment powering research, including on-prem GPU clusters and workload scheduling across hybrid cloud.
•Operate and continuously improve Beaker to optimize resource allocation and utilization across on-prem and elastic cloud resources.
•Execute and improve storage operations, balancing high-throughput training performance with cost-effective durability for petascale data.
•Manage GPU compute allocation against budget, track utilization, and recommend when to burst to cloud vs. invest in on-prem capacity.
•Manage and grow a team of systems engineers, SREs, and software developers, setting standards for operational rigor and keeping the team unblocked.

Pay and Benefits

Salary: USD 146,880 - 220,320 annually

Perks:Health InsuranceDentalVisionEmployee Assistance401kCommuting AllowanceGym MembershipPaid LeaveAnnual BonusPaid HolidaysParental Leave

Key Requirements

•12+ years in infrastructure, systems engineering, or HPC (or an advanced degree with 8+ years), including 2+ years supervising a small engineering team (5+).
•Bachelor's degree in a related field (or an advanced degree substituting for equivalent experience).
•Direct experience operating large-scale NVIDIA GPU clusters and high-performance networking (InfiniBand/RoCE).
•Strong background in Kubernetes, Slurm, or similar orchestration frameworks, especially in hybrid-cloud configurations.
•Hands-on experience with distributed filesystems (e.g., WEKA, Ceph, Lustre) and cloud storage integration at scale.

Experience:12+ yearsHPCInfrastructureDistributed systems

Education:Bachelor's

Skills:Hands-on technical problem-solvingOperational leadershipRisk triagePlanning & executionCommunication

Languages:English

Tech Stack:LinuxLinux kernelContainer runtimesDistributed systemsInfiniBandNCCLNVIDIA GPUBeakerAWSGCPGPU clustersHybrid cloudKubernetesSlurmWEKACephLustreGoPythonSDLC

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

AI2

The Allen Institute for AI (AI2) is a nonprofit research institute that builds AI systems and conducts fundamental research to contribute to scientific discovery, natural language understanding, and open-source tools for the AI community.

Industry: AI & Machine Learning

Company Size: Medium (51 to 250 employees)

Growth: Nonprofit & NGO

Funding: Grant Funded

Headquarters: Seattle, United States

Founded: 2014

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AI2