Software Engineer, Accelerators

OpenAI
San Francisco
Workplace: OnsiteFull timeUSD 295,000 - 380,000 annuallyFunction: Software EngineeringExperience: 3+ yearsSkills: ["Problem-solving","Communication"]

Software Engineer on the Accelerators team at OpenAI builds and optimizes the low-level software that enables large-scale AI training and inference on emerging accelerator platforms. You prototype system software, develop kernels and sharding strategies, model performance, and collaborate across hardware and software to adapt the stack for non-traditional hardware at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
1 year ago

Software Engineer, Accelerators

āœ“ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 12 minutes agoStatus: Live

Job Summary

Software Engineer on the Accelerators team at OpenAI builds and optimizes the low-level software that enables large-scale AI training and inference on emerging accelerator platforms. You prototype system software, develop kernels and sharding strategies, model performance, and collaborate across hardware and software to adapt the stack for non-traditional hardware at scale.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • ā€¢Prototype and enable OpenAI's AI software stack on new, exploratory accelerator platforms.
  • ā€¢Optimize large-scale model performance (LLMs, recommender systems, distributed AI workloads) for diverse hardware environments.
  • ā€¢Develop kernels, sharding mechanisms, and system scaling strategies tailored to emerging accelerators.
  • ā€¢Collaborate on optimizations at the model code level (e.g. PyTorch) and below to enhance performance on non-traditional hardware. Perform system-level performance modeling, debug bottlenecks, and drive end-to-end optimization.
  • ā€¢Work with hardware teams and vendors to evaluate alternatives to existing platforms and adapt the software stack to their architectures.

Pay and Benefits

Salary: USD 295,000 - 380,000 annually
Equity and Bonus:Equity

Key Requirements

  • ā€¢3+ years of experience working on AI infrastructure, including kernels, systems, or hardware-software co-design
  • ā€¢Hands-on experience with accelerator platforms for AI at data center scale (e.g., TPUs, custom silicon, exploratory architectures)
  • ā€¢Strong understanding of kernels, sharding, runtime systems, or distributed scaling techniques
  • ā€¢Familiarity with optimizing LLMs, CNNs, or recommender models for hardware efficiency
  • ā€¢Experience with performance modeling, system debugging, and software stack adaptation for novel architectures
Experience:3+ yearsAI infrastructureKernelsDistributed systemsHardware-software co-designAccelerator platforms
Skills:Problem-solvingCommunication
Tech Stack:PyTorchKernelsShardingDistributed systemsRuntimePerformance modeling

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALLĀ·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor