2 months ago

Principal AI Performance Modeling Architect

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 4 hours agoStatus: Live

Job Summary

Lead the design and optimization of AI infrastructure and GPU architectures to enable scalable, high-performance large-model training and inference, driving multi-2x–3x performance gains through innovative system design, parallelization, and memory-efficient training techniques.

Location: Santa Clara

Workplace: Onsite

Employment Type: Full time

Job Function: Solutions Engineering & Sales Engineering

Key Responsibilities

•Lead performance modeling and optimization for multi-trillion parameter LLM training/inference including Dense, Mixture of Experts (MoE) with multiple modalities (text, vision, speech).
•Model/optimize novel parallelization strategies across tensor, pipeline, context, expert and data parallel dimensions.
•Architect memory-efficient training systems utilizing techniques like structured pruning, quantization (MX formats), continuous batching/chunked prefill, speculative decoding.
•Incorporate and extend SOTA models such as GPT-4, Reasoning models (Deepseek-R1), and multi-modal architectures.
•Collaborate with internal and external stakeholders/ML researchers to disseminate results and iterate at rapid pace.

Key Requirements

•Extensive and senior experience optimizing large-scale ML systems and GPU architectures.
•Deep expertise in CUDA programming, GPU memory hierarchies, and hardware-specific optimizations.
•Proven track record architecting distributed training systems handling large-scale systems.
•Expert knowledge of transformer architectures, attention mechanisms, and model parallelism techniques.
•Bachelor’s, Master’s, or PhD in Computer Science/Engineering or equivalent industry experience.

Experience:AIMLGPUDistributed systemsGPU architectures

Education:Master's

Skills:CUDAPyTorchTensorRTOpenAI TritonRayMegatron-LMNSight ComputeNvprofPyTorch ProfilerFlash AttentionMixture of ExpertsInfiniBandRDMANVLinkGPU programmingDistributed training

Languages:English (US)English

Tech Stack:CUDAPyTorchTensorRTOpenAI TritonRayMegatron-LMNSight ComputeNvprofPyTorch ProfilerKV cache optimizationFlash AttentionMixture of ExpertsInfiniBandRDMANVLink

Company Brief

AMD

Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1969

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AMD