Machine Learning Infrastructure Engineer

Whatnot
San Francisco, New York, Los Angeles, Seattle
Full timeUSD 200,000 - 345,000 annuallyFunction: DevOps, Cloud & InfrastructureExperience: 4+ yearsEducation: bachelorsSkills: ["Autonomous execution","Initiative driving","Communication","Documentation","Collaboration"]

Design and scale the infrastructure that powers AI/ML and self-hosted large language model applications across critical Whatnot surfaces like recommendations, trust & safety, fraud, and seller tooling. Build low-latency, high-throughput inference and distributed training pipelines using GPUs and model/data parallelism. Prototype and productionalize novel ML architectures in partnership with machine learning scientists, ensuring dependable performance at consumer-scale loads.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Whatnot
Whatnot
2 months ago

Machine Learning Infrastructure Engineer

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Design and scale the infrastructure that powers AI/ML and self-hosted large language model applications across critical Whatnot surfaces like recommendations, trust & safety, fraud, and seller tooling. Build low-latency, high-throughput inference and distributed training pipelines using GPUs and model/data parallelism. Prototype and productionalize novel ML architectures in partnership with machine learning scientists, ensuring dependable performance at consumer-scale loads.
Location: San Francisco, New York, Los Angeles, Seattle
Employment Type: Full time
Job Function: DevOps, Cloud & Infrastructure
Seniority: Mid level

Key Responsibilities

  • •Own infrastructure powering AI/ML models across key business surfaces such as recommendations, trust & safety, fraud, and seller tooling.
  • •Prototype, deploy, and productionalize novel ML architectures that shape user experience and marketplace dynamics.
  • •Design and scale inference infrastructure for large models with low latency and high throughput.
  • •Build distributed training and inference pipelines leveraging GPUs and model/data parallelism.
  • •Take on new technical challenges to scale AI across the Whatnot ecosystem as requirements evolve.

Pay and Benefits

Salary: USD 200,000 - 345,000 annually
Perks:Health InsuranceDentalVisionRemote WorkPaid Leave

Key Requirements

  • •4+ years of professional experience developing machine learning systems and algorithms, plus relevant technical background.
  • •Bachelor’s degree in Computer Science, Statistics, Applied Mathematics (or related) or equivalent work experience.
  • •3+ years building and maintaining production software systems for consumer-scale loads.
  • •1+ years developing software in Python.
  • •Experience with production databases and operational/monitoring tools (e.g., PostgreSQL, DynamoDB, Elasticsearch, Redis; DataDog, Grafana) and familiarity with cloud managed services (e.g., AWS).
Experience:4+ yearsMachine learningAILarge language models
Education:Bachelor's in Computer Science, Statistics, Applied Mathematics (or related technical field)
Skills:Autonomous executionInitiative drivingCommunicationDocumentationCollaboration
Tech Stack:PythonPostgreSQLDynamoDBElasticsearchRedisDataDogGrafanaAWS SagemakerLambdaKinesisS3EC2EKSECSApache KafkaFlink

Company Brief

Whatnot
Whatnot is a live-stream shopping marketplace connecting sellers and collectors for trading cards, toys, and collectibles. The platform hosts live auctions and interactive streams, enabling creators and small businesses to sell directly to engaged communities.
Industry: Online Marketplaces
Company Size: Large (251 to 1,000 employees)
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: United States
Founded: 2019
WebsiteLinkedIn