AMD

4 weeks ago

AI Framework Eng.

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 44 minutes agoStatus: Live

Job Summary

Dynamic, upbeat software engineer role focused on building and optimizing high-performance AI inference components for multi-GPU systems. You will work on deep learning and LLM/multimodal frameworks, collaborating with GPU library teams and open-source maintainers to improve throughput, latency, and scalability across large-scale models.

Location: Shanghai

Workplace: Onsite

Employment Type: Full time

Job Function: Data Science & Machine Learning

Seniority: Entry level

Key Responsibilities

•Deep Learning & LLM Framework Optimization: Experience with optimizing major DL/LLM frameworks (PyTorch, vLLM, SGLang) for AMD GPUs and contribute improvements upstream.
•Model-Aware Implementation: Build features that interact closely with LLMs and multimodal architectures (e.g., Llama, Qwen-VL, Wan), requiring understanding of attention mechanisms, cross-modal fusion, KV caching, and quantization.
•Performance-Conscious Coding: Write efficient, scalable code while considering memory usage, concurrency, and bottlenecks in multi-GPU environments.
•Profiling: Use profiling tools to evaluate the impact of changes, identify regressions, and validate performance improvements as part of the development cycle.
•End-to-End Performance Engineering: Profile to identify bottlenecks and implement optimizations across multi-GPU and multi-node setups.

Key Requirements

•Proficiency in Python and/or C++ in Linux environments with hands-on ML/DL exposure.
•Experience or strong academic exposure to deep learning systems, large language models (LLMs), and multimodal architectures.

Experience:AIGPUMultimodalLLM

Education:Bachelor's

Languages:EnglishChinese

Tech Stack:PythonC++LinuxPyTorchCUDAROCmKV cachingQuantizationProfiling

Company Brief

AMD

Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1969

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AMD