Software Engineer, Trainium

OpenAI
San Francisco
Workplace: HybridFull timeUSD 295,000 - 380,000 annuallyFunction: Software EngineeringExperience: 3+ yearsSkills: ["Self-directed","Performance-minded","Problem-solving","Collaboration","Cross-stack execution"]

Build and optimize OpenAI’s inference stack for AWS Trainium, working across kernels, compilers, and model execution. Develop high-performance kernels for critical workloads, improve compiler support to target Trainium hardware, and enable efficient execution of the model forward pass. Profile end-to-end performance, identify bottlenecks across the stack, and partner with inference and ML systems teams to bring new model architectures onto Trainium.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
1 day ago

Software Engineer, Trainium

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 3 hours agoStatus: Live

Job Summary

Build and optimize OpenAI’s inference stack for AWS Trainium, working across kernels, compilers, and model execution. Develop high-performance kernels for critical workloads, improve compiler support to target Trainium hardware, and enable efficient execution of the model forward pass. Profile end-to-end performance, identify bottlenecks across the stack, and partner with inference and ML systems teams to bring new model architectures onto Trainium.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build and optimize OpenAI’s inference stack for AWS Trainium.
  • •Develop high-performance kernels for critical model operations and workloads.
  • •Extend and improve compiler support to efficiently target Trainium hardware.
  • •Build systems to execute and optimize the model forward pass on Trainium.
  • •Profile workloads to identify bottlenecks and partner with inference/ML systems teams to bring new models and architectures onto Trainium.

Pay and Benefits

Salary: USD 295,000 - 380,000 annually

Key Requirements

  • •3+ years of relevant engineering experience, ideally in ML systems, compilers, kernels, runtimes, or performance engineering.
  • •Strong systems programming fundamentals and experience writing performance-critical software.
  • •Experience working with GPU, TPU, Trainium, or other specialized accelerator architectures.
  • •Ability to reason about performance across multiple stack layers, from hardware and kernels through compilers and ML frameworks.
  • •Ability to own technically ambiguous problems end-to-end and learn new hardware/software domains as needed.
Experience:3+ yearsML systemsCompilersKernelsRuntimesPerformance engineering
Skills:Self-directedPerformance-mindedProblem-solvingCollaborationCross-stack execution
Tech Stack:AWS TrainiumAWS Neuron SDKGPUTPUPyTorchJAXLLVMMLIRXLATriton

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor