Senior Product Manager –AI Inference Software

AMD
San Francisco, Austin
Workplace: HybridFull timeFunction: Product ManagementEducation: bachelorsSkills: ["Written communication","Roadmap communication","Strategic thinking","Technical fluency","Collaboration"]

Drive strategy and execution for ROCm’s large-scale model inference software, connecting open-source community needs with production AI deployment. Own the inference-focused product roadmap, including integrations with PyTorch and JAX and runtimes like vLLM and SGLang. Partner with engineering to plan releases and ensure ecosystem readiness, represent AMD at major conferences, and collaborate with enterprise customers and partners such as Hugging Face and Red Hat.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
AMD
AMD
2 months ago

Senior Product Manager –AI Inference Software

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 16 hours agoStatus: Live

Job Summary

Drive strategy and execution for ROCm’s large-scale model inference software, connecting open-source community needs with production AI deployment. Own the inference-focused product roadmap, including integrations with PyTorch and JAX and runtimes like vLLM and SGLang. Partner with engineering to plan releases and ensure ecosystem readiness, represent AMD at major conferences, and collaborate with enterprise customers and partners such as Hugging Face and Red Hat.
Location: San Francisco, Austin
Workplace: Hybrid
Employment Type: Full time
Job Function: Product Management
Seniority: Sr. Manager level

Key Responsibilities

  • •Own ROCm’s inference software product roadmap, including integrations with PyTorch and JAX and runtimes like vLLM and SGLang.
  • •Define and communicate strategy for production inference workloads from single-GPU to rack-scale deployments, emphasizing developer experience and performance portability.
  • •Monitor OSS and AI/ML trends to identify when new model architectures, runtimes, or inference techniques require an AMD software response.
  • •Represent AMD in open-source communities and at conferences, and publish roadmap and technical updates to solicit feedback.
  • •Partner with engineering and customers to translate requirements into prioritized work, drive release planning with compatibility/regression focus, and coordinate ecosystem readiness.

Key Requirements

  • •Bachelor’s degree in Computer Science, Electrical Engineering, or related technical field, or equivalent experience.
  • •Proven years of product management experience in a software-focused role, ideally developer tools, GPU computing, or AI/ML infrastructure.
  • •Deep familiarity with at least one of PyTorch, JAX, or Triton, including how work is dispatched to hardware backends.
  • •Practical understanding of LLM inference concepts such as attention mechanisms, KV cache design, quantization, continuous batching, speculative decoding, and parallel serving.
  • •Hands-on familiarity with GPU programming (HIP, CUDA, or Triton kernels) with the ability to read kernel-level code and benchmark results.
Experience:Open-sourceAI/ML infrastructureGPU computingHigh-performance computing
Education:Bachelor's in Computer Science or Electrical Engineering (or related technical field)
Skills:Written communicationRoadmap communicationStrategic thinkingTechnical fluencyCollaboration
Languages:English
Tech Stack:ROCmAMD InstinctRadeonPyTorchJAXVLLMSGLangGitHubDiscordCI/CDHIPCUDATritonHugging FaceRed HatGitHub workflowsOSS release management

Eligibility

Work Authorization:Authorization required. Sponsorship not provided.

Company Brief

AMD
Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Santa Clara, United States
Founded: 1969
Glassdoor
Glassdoor: 3.9
WebsiteLinkedIn