AMD

3 months ago

AI Systems Engineer – AI Model (Training & Inference)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Senior Software Development Engineer role owning the end-to-end model execution stack on AMD Instinct GPUs, spanning large-scale training infrastructure and high-performance inference serving. Expect hands-on work shipping LLMs on real hardware, building orchestration, storage, and monitoring systems, and ensuring GPUs are first-class citizens for frontier model training and inference across current and next-gen accelerators.

Location: Markham

Workplace: Hybrid

Employment Type: Full time

Job Function: IT Operations (Systems/Network Admin)

Seniority: Manager level

Key Responsibilities

•Own the end-to-end model execution stack for training and inference on AMD Instinct GPUs.
•Build and maintain training infrastructure: job orchestration, distributed checkpointing, data loading pipelines, and storage optimization for multi-thousand GPU clusters on Kubernetes.
•Debug and resolve training-specific issues including gradient norm explosions, non-deterministic behavior across GPU generations, and compute-communication overlap in distributed training (FSDP, DeepSpeed, Megatron-LM).
•Optimize RCCL collective communication patterns for training workloads, including all-reduce, all-gather, and reduce-scatter across multi-node topologies.
•Design and build end-to-end validation and testing infrastructure, monitoring, and observability tooling to ensure training cluster health, data security, and SLA adherence at scale.

Key Requirements

•Industry experience shipping production AI/ML infrastructure, with hands-on work spanning both training and inference.
•Direct experience enabling frontier models (GPT-4 class) on AMD Instinct hardware end-to-end.
•Familiarity with AMD Instinct MI-series architectures (MI300X, MI350X, MI355X) and RCCL communication library.
•Contributions to open-source AI frameworks (PyTorch, vLLM, SGLang, DeepSpeed, Megatron-LM).
•Experience designing validation frameworks, proxy benchmarks, or synthetic workload suites for GPU infrastructure at scale.

Experience:AI/ML infrastructureGPUHPC

Education:Bachelor's

Skills:CommunicationProblem-solvingCollaborationTeamworkAnalytical thinking

Languages:English

Tech Stack:PythonHIPTritonMLIRPyTorchDeepSpeedMegatron-LMCUDARCCL

Company Brief

AMD

Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1969

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AMD