Intern - AI Systems and Infrastructure Engineering

Micron Technology
Austin
Workplace: OnsiteInternshipFunction: DevOps, Cloud & InfrastructureSkills: ["Profiling","Experimentation","Performance analysis","Software development","Collaboration"]

Work on systems software for Large Language Models and agentic AI applications, partnering with senior engineers and researchers to profile and improve training/inference performance. You’ll characterize workload behavior across GPUs and heterogeneous memory/storage, design memory and state-management techniques, and build benchmarking, simulation, and automation tools. The role emphasizes latency, throughput, scalability, and resource utilization, contributing to experimental results and future AI infrastructure roadmaps.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Micron Technology
Micron Technology
1 week ago

Intern - AI Systems and Infrastructure Engineering

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Work on systems software for Large Language Models and agentic AI applications, partnering with senior engineers and researchers to profile and improve training/inference performance. You’ll characterize workload behavior across GPUs and heterogeneous memory/storage, design memory and state-management techniques, and build benchmarking, simulation, and automation tools. The role emphasizes latency, throughput, scalability, and resource utilization, contributing to experimental results and future AI infrastructure roadmaps.
Location: Austin
Workplace: Onsite
Employment Type: Internship
Job Function: DevOps, Cloud & Infrastructure
Seniority: Intern level

Key Responsibilities

  • •Develop and enhance systems software, profiling tools, and experimentation frameworks for LLM training, LLM inference, and agentic AI workloads.
  • •Design, implement, and evaluate memory- and state-management techniques for AI serving environments, including caching, tiering, compression, eviction, and lifecycle management.
  • •Characterize and optimize AI workload execution across GPUs, CPUs, memory subsystems, storage, and distributed infrastructure with focus on latency, throughput, scalability, and resource utilization.
  • •Build benchmarking, simulation, and automation capabilities to evaluate data placement, migration, scheduling, and performance across heterogeneous memory systems.
  • •Collaborate with engineering and research teams on representative AI workloads, analyze results, and contribute to technical publications, intellectual property, and future platform designs.

Pay and Benefits

Perks:MedicalDentalVisionPaid LeavePaid Holidays

Key Requirements

  • •Currently pursuing a Master’s or Ph.D. in Computer Science, Computer Engineering, Electrical Engineering, or a related technical field.
  • •Demonstrated experience with AI systems, machine learning systems, computer systems research, or systems software development through coursework, research, or projects.
  • •Understanding of Large Language Models (LLMs), including transformer execution, attention mechanisms, KV cache behavior, batching, and token-level latency/throughput.
  • •Proficiency in Python and C/C++, with hands-on software development, debugging, and optimization in Linux environments.
  • •Experience with GPU-based performance analysis tools and at least one modern AI framework/serving stack such as PyTorch, vLLM, TensorRT-LLM, or NVIDIA Dynamo.
Experience:AIMachine learning systemsDistributed systemsComputer systems researchHigh-performance computing
Education:
Skills:ProfilingExperimentationPerformance analysisSoftware developmentCollaboration
Tech Stack:PythonC/C++LinuxPyTorchVLLMTensorRT-LLMNVIDIA DynamoCUDATritonNCCLRDMAHBMDRAMCXLNVMeCXL-attached memory

Company Brief

Micron Technology
Designs and manufactures semiconductor memory and storage solutions, including DRAM, NAND, and NOR flash, for computing, networking, mobile, and automotive markets worldwide.
Industry: Electronics Manufacturing
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Public Company
Valuation: Public Company (Market Cap in USD)
Funding: IPO / Publicly Listed
Headquarters: Boise, United States
Founded: 1978
Glassdoor
Glassdoor: 3.7
WebsiteLinkedIn