AMD

3 weeks ago

Senior Product Manager –AI/ML Inference Software

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 5 hours agoStatus: Live

Job Summary

Drive strategy and execution for ROCm’s large-scale model inference software, connecting open-source community needs with production AI deployment. Own the inference-focused product roadmap, including integrations with PyTorch and JAX and runtimes like vLLM and SGLang. Partner with engineering to plan releases and ensure ecosystem readiness, represent AMD at major conferences, and collaborate with enterprise customers and partners such as Hugging Face and Red Hat.

Location: San Francisco, Austin

Workplace: Hybrid

Employment Type: Full time

Job Function: Product Management

Seniority: Sr. Manager level

Key Responsibilities

•Own ROCm’s inference software product roadmap, including integrations with PyTorch and JAX and runtimes like vLLM and SGLang.
•Define and communicate strategy for production inference workloads from single-GPU to rack-scale deployments, emphasizing developer experience and performance portability.
•Monitor OSS and AI/ML trends to identify when new model architectures, runtimes, or inference techniques require an AMD software response.
•Represent AMD in open-source communities and at conferences, and publish roadmap and technical updates to solicit feedback.
•Partner with engineering and customers to translate requirements into prioritized work, drive release planning with compatibility/regression focus, and coordinate ecosystem readiness.

Key Requirements

•Bachelor’s degree in Computer Science, Electrical Engineering, or related technical field, or equivalent experience.
•Proven years of product management experience in a software-focused role, ideally developer tools, GPU computing, or AI/ML infrastructure.
•Deep familiarity with at least one of PyTorch, JAX, or Triton, including how work is dispatched to hardware backends.
•Practical understanding of LLM inference concepts such as attention mechanisms, KV cache design, quantization, continuous batching, speculative decoding, and parallel serving.
•Hands-on familiarity with GPU programming (HIP, CUDA, or Triton kernels) with the ability to read kernel-level code and benchmark results.

Experience:Open-sourceAI/ML infrastructureGPU computingHigh-performance computing

Education:Bachelor's in Computer Science or Electrical Engineering (or related technical field)

Skills:Written communicationRoadmap communicationStrategic thinkingTechnical fluencyCollaboration

Languages:English

Tech Stack:ROCmAMD InstinctRadeonPyTorchJAXVLLMSGLangGitHubDiscordCI/CDHIPCUDATritonHugging FaceRed HatGitHub workflowsOSS release management

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

AMD

Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1969

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AMD