AMD

5 months ago

LLM Inference Performance Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 14 hours agoStatus: Live

Job Summary

Role focused on performance analysis and optimization of production AI services within the AMD Inference Microservice ecosystem. You’ll measure, analyze, and optimize LLM/model performance across latency and throughput, build tooling for deployment performance, and collaborate across a fast-moving AI infrastructure team.

Location: Helsinki

Workplace: Onsite

Employment Type: Full time

Key Responsibilities

•Measure, analyze, and optimize LLM and AI service performance across metrics like latency and throughput for various training and inference use cases
•Design and implement methodologies for measuring model performance, and automating optimization strategies to identify optimal configurations
•Stay on top of current advances in AI, models, APIs, and open-source ecosystems, and translate them into scalable solutions
•Design and develop tooling to measure and analyze the performance of AI model deployments and the effect of different configurations and infrastructure, standalone and Kubernetes clusters
•Develop and maintain internal tooling to support LLM and AI performance tuning at scale

Key Requirements

•Bachelor’s or master’s degree in computer science, computer engineering, electrical engineering, or an equivalent field

Experience:AIMLInferenceCloud

Education:Bachelor's

Skills:Problem-solvingCommunicationCollaborationInitiative

Languages:English

Tech Stack:PythonBashDockerKubernetesHelmVLLMSGLangCUDA

Company Brief

AMD

Designs and produces semiconductor products including CPUs, GPUs, and adaptive SoCs for consumer, enterprise, and embedded markets, competing across PCs, data centers, and gaming industries.

Industry: Electronics Manufacturing

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Public Company

Valuation: Public Company (Market Cap in USD)

Funding: IPO / Publicly Listed

Headquarters: Santa Clara, United States

Founded: 1969

Glassdoor: 3.9

Website LinkedIn

Loading job details...

Preparing the role view and application actions.

AMD