Software Engineer, Search Infrastructure

OpenAI
San Francisco
Workplace: HybridFull timeUSD 266,000 - 445,000 annuallyFunction: Software EngineeringSkills: ["Programming","Systems debugging","Profiling","Debugging","Collaboration","Communication","Problem-solving","Project execution"]

Design, build, and operate the systems that connect models with search at ChatGPT scale. Work on search orchestration, inference efficiency, experimentation, and production reliability—owning projects from technical design through launch and iteration. Improve latency, throughput, and infrastructure efficiency through profiling, caching, routing, and capacity planning. Build experimentation tooling, ensure robust observability and incident response, and develop search APIs that support access controls and source attribution.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
1 day ago

Software Engineer, Search Infrastructure

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 47 minutes agoStatus: Live

Job Summary

Design, build, and operate the systems that connect models with search at ChatGPT scale. Work on search orchestration, inference efficiency, experimentation, and production reliability—owning projects from technical design through launch and iteration. Improve latency, throughput, and infrastructure efficiency through profiling, caching, routing, and capacity planning. Build experimentation tooling, ensure robust observability and incident response, and develop search APIs that support access controls and source attribution.
Location: San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Design and evolve services that coordinate search classification, retrieval, ranking, and model inference for ChatGPT scale.
  • •Improve end-to-end latency, throughput, and infrastructure efficiency via profiling, caching, request routing, and capacity planning.
  • •Build experimentation tooling and automation to run reproducible A/B tests, define success metrics, and measure product impact.
  • •Own production reliability using observability, resilient fallback behavior, incident response, and automation to reduce operational toil.
  • •Build search APIs and tool interfaces enabling reliable retrieval for models and agents while respecting access controls and preserving source attribution.

Pay and Benefits

Salary: USD 266,000 - 445,000 annually
Equity and Bonus:Equity
Perks:Relocation

Key Requirements

  • •Significant experience designing, building, and operating large-scale distributed systems with depth in performance, reliability, or resource efficiency.
  • •Experience in one or more of search, information retrieval, ML infrastructure, inference serving, or other high-throughput online systems.
  • •Strong programming and systems debugging skills, comfortable working across languages and unfamiliar parts of a production stack.
  • •Ability to turn ambiguous product or research needs into clear technical plans and measurable results.
  • •Comfort partnering with researchers and partner engineering teams to align and execute technical plans.
Experience:Distributed systemsSearchInformation retrievalML infrastructureInference serving
Skills:ProgrammingSystems debuggingProfilingDebuggingCollaborationCommunicationProblem-solvingProject execution

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor