Systems Generalist, GPT Infrastructure

OpenAI
San Francisco, Seattle
Workplace: HybridFull timeUSD 293,000 - 385,000 annuallyFunction: Software EngineeringExperience: 8+ yearsSkills: ["Systems thinking","Performance intuition","Collaboration","Debugging","Technical leadership"]

Build and operate an automated inference optimization platform that turns candidate kernels and runtime configurations into repeatable, trustworthy product workflows. Design OpenAI-hosted control-plane services and partner-side runner and grader software to compile, execute, verify, and benchmark artifacts on third-party accelerator hardware. Ensure long-running campaigns are reliable, results are reproducible, and performance and correctness evaluation systems cover latency, throughput, memory, utilization, and cost efficiency.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
1 month ago

Systems Generalist, GPT Infrastructure

āœ“ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 5 hours agoStatus: Live

Job Summary

Build and operate an automated inference optimization platform that turns candidate kernels and runtime configurations into repeatable, trustworthy product workflows. Design OpenAI-hosted control-plane services and partner-side runner and grader software to compile, execute, verify, and benchmark artifacts on third-party accelerator hardware. Ensure long-running campaigns are reliable, results are reproducible, and performance and correctness evaluation systems cover latency, throughput, memory, utilization, and cost efficiency.
Location: San Francisco, Seattle
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • ā€¢Design, build, and operate durable control-plane APIs and services for multi-hour or multi-day optimization campaigns with scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
  • ā€¢Build secure partner-side runner and grader software that compiles, executes, verifies, and benchmarks candidate artifacts on third-party accelerator hardware.
  • ā€¢Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into a repeatable optimization workflow.
  • ā€¢Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and strong developer ergonomics.
  • ā€¢Develop correctness and performance evaluation systems covering latency, throughput, memory use, utilization, and cost efficiency.

Pay and Benefits

Salary: USD 293,000 - 385,000 annually
Equity and Bonus:Equity

Key Requirements

  • ā€¢8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services.
  • ā€¢Strong programming skills in one or more of C++, Python, Go, or Rust.
  • ā€¢Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
  • ā€¢Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
  • ā€¢Proven ability to lead complex technical initiatives as a senior individual contributor across organizational boundaries.
Experience:8+ yearsAI infrastructureInference-serving systemsLarge-scale machine learning systems
Skills:Systems thinkingPerformance intuitionCollaborationDebuggingTechnical leadership
Tech Stack:C++PythonGoRustLinuxNetworkingStorageContainersCloud architecturesCompilersRuntimesLLVMMLIRTritonCUDAROCmGPUsAcceleratorsISAToolchains

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALLĀ·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor