OpenAI

5 days ago

Systems Generalist, GPT Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Build and operate an automated inference optimization platform that turns candidate kernels and runtime configurations into repeatable, trustworthy product workflows. Design OpenAI-hosted control-plane services and partner-side runner and grader software to compile, execute, verify, and benchmark artifacts on third-party accelerator hardware. Ensure long-running campaigns are reliable, results are reproducible, and performance and correctness evaluation systems cover latency, throughput, memory, utilization, and cost efficiency.

Location: San Francisco, Seattle

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design, build, and operate durable control-plane APIs and services for multi-hour or multi-day optimization campaigns with scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
•Build secure partner-side runner and grader software that compiles, executes, verifies, and benchmarks candidate artifacts on third-party accelerator hardware.
•Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into a repeatable optimization workflow.
•Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and strong developer ergonomics.
•Develop correctness and performance evaluation systems covering latency, throughput, memory use, utilization, and cost efficiency.

Pay and Benefits

Salary: USD 293,000 - 385,000 annually

Equity and Bonus:Equity

Key Requirements

•8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services.
•Strong programming skills in one or more of C++, Python, Go, or Rust.
•Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
•Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
•Proven ability to lead complex technical initiatives as a senior individual contributor across organizational boundaries.

Experience:8+ yearsAI infrastructureInference-serving systemsLarge-scale machine learning systems

Skills:Systems thinkingPerformance intuitionCollaborationDebuggingTechnical leadership

Tech Stack:C++PythonGoRustLinuxNetworkingStorageContainersCloud architecturesCompilersRuntimesLLVMMLIRTritonCUDAROCmGPUsAcceleratorsISAToolchains

Company Brief

OpenAI

Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Scaleup

Valuation: Hectocorn (USD 100B+)

Funding: Series E+

Headquarters: San Francisco, United States

Founded: 2015

Glassdoor: 4.4

Website LinkedIn Glassdoor

Loading job details...

Preparing the role view and application actions.

OpenAI

5 days ago

Systems Generalist, GPT Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI

Last checked: 11 hours agoStatus: Live

Job Summary

Location: San Francisco, Seattle

Workplace: Hybrid

Employment Type: Full time

Job Function: Software Engineering

Seniority: Mid level

Key Responsibilities

•Design, build, and operate durable control-plane APIs and services for multi-hour or multi-day optimization campaigns with scheduling, retries, budgets, checkpoints, artifact lineage, and observability.
•Build secure partner-side runner and grader software that compiles, executes, verifies, and benchmarks candidate artifacts on third-party accelerator hardware.
•Integrate hardware profiles, ISA and toolchain context, compilers, runtimes, and inference-serving engines into a repeatable optimization workflow.
•Turn research prototypes into reliable product surfaces with clear contracts, debuggable failure modes, reproducible outputs, and strong developer ergonomics.
•Develop correctness and performance evaluation systems covering latency, throughput, memory use, utilization, and cost efficiency.

Pay and Benefits

Salary: USD 293,000 - 385,000 annually

Equity and Bonus:Equity

Key Requirements

•8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services.
•Strong programming skills in one or more of C++, Python, Go, or Rust.
•Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads.
•Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud architectures.
•Proven ability to lead complex technical initiatives as a senior individual contributor across organizational boundaries.

Experience:8+ yearsAI infrastructureInference-serving systemsLarge-scale machine learning systems

Skills:Systems thinkingPerformance intuitionCollaborationDebuggingTechnical leadership

Tech Stack:C++PythonGoRustLinuxNetworkingStorageContainersCloud architecturesCompilersRuntimesLLVMMLIRTritonCUDAROCmGPUsAcceleratorsISAToolchains

Company Brief

OpenAI

Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.

Industry: AI & Machine Learning

Company Size: Enterprise (1,001+ employees)

Revenue: USD 1B+

Growth: Scaleup

Valuation: Hectocorn (USD 100B+)

Funding: Series E+

Headquarters: San Francisco, United States

Founded: 2015

Glassdoor: 4.4

Website LinkedIn Glassdoor