Backend Software Engineer (Evals)

OpenAI
San Francisco, Seattle
Workplace: OnsiteFull timeUSD 230,000 - 385,000 annuallyFunction: Software EngineeringExperience: 4+ yearsSkills: ["Communication","Collaboration","Problem-solving"]

Backend Software Engineer with ML/LLM-focused work, designing and building an evals infrastructure to measure OpenAI’s support automation. You’ll develop robust backend services, pipelines, and APIs, collaborate with data science and research teams, and own end-to-end lifecycle of new platform capabilities at scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
OpenAI
OpenAI
8 months ago

Backend Software Engineer (Evals)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Backend Software Engineer with ML/LLM-focused work, designing and building an evals infrastructure to measure OpenAI’s support automation. You’ll develop robust backend services, pipelines, and APIs, collaborate with data science and research teams, and own end-to-end lifecycle of new platform capabilities at scale.
Location: San Francisco, Seattle
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design eval pipelines that are reliable, reproducible, and extendable.
  • •Build the infrastructure for continuous eval monitoring frameworks (regression/drift monitoring, building robust golden datasets) along with feedback loops that ultimately strengthen support automation
  • •Design, build, and maintain backend services and APIs to support intelligent automation and knowledge systems
  • •Integrate and structure data across internal platforms, transforming it into formats optimized for use by downstream systems and AI workflows
  • •Collaborate closely with data, research, and engineering teams to integrate OpenAI models into high-leverage workflows

Pay and Benefits

Salary: USD 230,000 - 385,000 annually
Equity and Bonus:Equity
Perks:Equity

Key Requirements

  • •4+ years of backend engineering experience at product-driven companies (excluding internships)
  • •Proficiency in backend technologies. Our tech stack includes Python, FastAPI, and Postgres
  • •Experience designing and scaling distributed systems, APIs, or data processing pipelines
  • •Have experience building AI agents or applications, including designing evals and improving performance through prompting or scaffolding
  • •Are familiar with evaluation methods for LLMs and have worked with patterns like multi-agent workflows, tool use, or long context.
Experience:4+ yearsMLLLMAIOpenAI
Skills:CommunicationCollaborationProblem-solving
Tech Stack:PythonFastAPIPostgresAPIsSQL

Company Brief

OpenAI
Develops and deploys advanced generative AI models (including ChatGPT and DALL·E) and AI infrastructure, providing APIs and consumer products to accelerate safe AGI for broad benefit.
Industry: AI & Machine Learning
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Scaleup
Valuation: Hectocorn (USD 100B+)
Funding: Series E+
Headquarters: San Francisco, United States
Founded: 2015
Glassdoor
Glassdoor: 4.4
WebsiteLinkedInGlassdoor