Software Engineer, Productivity - Inference Runtime

OpenAI
San Francisco
Workplace: OnsiteFull timeUSD 230,000 - 385,000 annuallyFunction: Software EngineeringSkills: ["Python","C++","CI/CD","Testing","Release tooling","GPU scheduling","Infrastructure","Observability"]

Join OpenAI as a Developer Productivity Engineer for the Inference Runtime. You’ll build and harden tooling, CI/CD pipelines, and release processes that ensure correct, performant inference engine images across Codex, ChatGPT, and API deployments. You’ll partner with inference teams to improve validation, observability, and rollout safety, helping engineers move faster with reliability and confidence in a high-scale production stack.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
3 months ago

Software Engineer, Productivity - Inference Runtime

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 2 hours agoStatus: Live

Job Summary

Join OpenAI as a Developer Productivity Engineer for the Inference Runtime. You’ll build and harden tooling, CI/CD pipelines, and release processes that ensure correct, performant inference engine images across Codex, ChatGPT, and API deployments. You’ll partner with inference teams to improve validation, observability, and rollout safety, helping engineers move faster with reliability and confidence in a high-scale production stack.
Location: San Francisco
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Improve systems that ensure inference engine releases are correct, performant, and regression-free by evolving tooling and infrastructure for deploy gate validation
  • •Bring rigor to release, validation, branching, and deployment processes across the inference stack
  • •Improve canary, async, and large-scale validation workflows for inference systems
  • •Harden CI, testing, and validation infrastructure so failures are actionable and trustworthy
  • •Reduce noisy or flaky failures caused by infrastructure instability, GPU scheduling, or test environment issues

Pay and Benefits

Salary: USD 230,000 - 385,000 annually

Key Requirements

  • •Must have strong experience with CI/CD systems, testing infrastructure, release tooling, and developer productivity
Experience:AIInferenceCloud
Skills:PythonC++CI/CDTestingRelease toolingGPU schedulingInfrastructureObservability
Languages:English
Tech Stack:PythonC++CI/CDGPU schedulingInfrastructureObservability

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor