LLM Platform Engineer

Whatnot
San Francisco, Los Angeles, New York, Seattle
Workplace: HybridFull timeUSD 245,000 - 345,000 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Autonomous execution","Communication","Documentation","Collaboration","Initiative"]

Design and scale the core infrastructure for large language model applications across Whatnot. Own systems that power LLM-backed experiences such as recommendations, trust & safety, fraud, and seller tooling. Build scalable RAG and MCP-based solutions with strong PII controls, develop LLM evaluation frameworks with CI/CD, and implement human-in-the-loop feedback pipelines. Bridge research to production and improve reliability, performance, and iteration speed at consumer scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Whatnot
Whatnot
6 months ago

LLM Platform Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 59 minutes agoStatus: Live

Job Summary

Design and scale the core infrastructure for large language model applications across Whatnot. Own systems that power LLM-backed experiences such as recommendations, trust & safety, fraud, and seller tooling. Build scalable RAG and MCP-based solutions with strong PII controls, develop LLM evaluation frameworks with CI/CD, and implement human-in-the-loop feedback pipelines. Bridge research to production and improve reliability, performance, and iteration speed at consumer scale.
Location: San Francisco, Los Angeles, New York, Seattle
Workplace: Hybrid
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Own the infrastructure powering LLMs across key business surfaces including recommendations, trust and safety, fraud, and seller tooling.
  • •Create robust, scalable LLM evaluation frameworks that measure performance, guide iteration, and prevent regression via CI/CD.
  • •Deploy RAG systems and MCP servers to ground LLM responses in Whatnot’s business context while enforcing PII controls.
  • •Design human-in-the-loop feedback pipelines to support scalable LLM evaluation.
  • •Bridge research and production to turn experimental ideas into scalable solutions as AI grows across the ecosystem.

Pay and Benefits

Salary: USD 245,000 - 345,000 annually
Equity and Bonus:Equity
Perks:Health InsuranceDentalVisionEquityPaid LeaveRemote WorkHome OfficeMonthly Childcare401kPensionParental Leave

Key Requirements

  • •4+ years of professional experience developing machine learning systems and algorithms.
  • •Bachelor’s degree in Computer Science, Statistics, Applied Mathematics (or related) or equivalent work experience.
  • •3+ years of software engineering experience building and maintaining production systems for consumer-scale loads.
  • •1+ years of professional experience developing software in Python.
  • •Experience building production infrastructure including operational/search/key-value databases, observability tools, and cloud services (e.g., AWS).
Experience:4+ yearsMachine learningAIConsumer-scale systemsLLM
Education:Bachelor's in Computer Science, Statistics, Applied Mathematics
Skills:Autonomous executionCommunicationDocumentationCollaborationInitiative
Tech Stack:PythonPostgreSQLDynamoDBElasticsearchRedisDataDogGrafanaAWS SagemakerLambdaKinesisS3EC2EKSECSApache KafkaFlinkRAGMCPCI/CD

Company Brief

Whatnot
Whatnot is a live-stream shopping marketplace connecting sellers and collectors for trading cards, toys, and collectibles. The platform hosts live auctions and interactive streams, enabling creators and small businesses to sell directly to engaged communities.
Industry: Online Marketplaces
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: United States
Founded: 2019
WebsiteLinkedIn