Member of Technical Staff (Answer Quality & Evals)

Perplexity
San Francisco, Palo Alto
Workplace: OnsiteFull timeUSD 210,000 - 385,000 annuallyFunction: Software EngineeringExperience: 3+ yearsSkills: ["Problem-solving","Collaboration","Communication"]

You will build the data flywheel powering Perplexity’s evaluation platform, enabling multiple teams to access reliable eval verdicts, transform signals into durable data for decision-making, and simulate user interactions for LLMs/VLMs while maintaining data trust in a small, high-impact team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Perplexity
Perplexity
6 months ago

Member of Technical Staff (Answer Quality & Evals)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 10 hours agoStatus: Live

Job Summary

You will build the data flywheel powering Perplexity’s evaluation platform, enabling multiple teams to access reliable eval verdicts, transform signals into durable data for decision-making, and simulate user interactions for LLMs/VLMs while maintaining data trust in a small, high-impact team.
Location: San Francisco, Palo Alto
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering
Seniority: Mid level

Key Responsibilities

  • •Build the systems and pipelines that enable Search, Product, and other teams to independently access and utilize reliable eval verdicts without bottlenecks.
  • •Take ownership of the "evals-to-product" loop, autonomously determining the best way to turn raw signals into durable datasets that power decision-making across the company.
  • •Build a robust simulator pipeline capable of replaying user interactions with the product in formats legible to LLMs and VLMs, reflecting product changes as they are shipped.
  • •Maintain data trust by implementing monitoring, lineage, and quality checks, ensuring downstream consumers can rely on the results implicitly.
  • •Operate in a small, high-impact team where your work directly shapes how Perplexity measures and improves Answer Quality

Pay and Benefits

Salary: USD 210,000 - 385,000 annually
Equity and Bonus:Equity

Key Requirements

  • •3+ years of software engineering experience shipping production systems.
  • •Strong proficiency in Python and SQL with the ability to write production-grade, maintainable code.
  • •Experience with big data systems including distributed compute and large-scale storage.
  • •Solid fundamentals in data modeling, system design, and debugging distributed systems.
  • •Experience with AWS and lakehouse ecosystems like Databricks or Spark.
Experience:3+ yearsAiData engineeringBig dataMachine learning
Skills:Problem-solvingCollaborationCommunication
Tech Stack:PythonSQLAWSDatabricksSparkLLMVLMLakehouse

Company Brief

Perplexity
Perplexity AI provides an AI-powered answer engine that returns conversational, citation-backed answers to user queries and offers Pro/Enterprise products and APIs for research, knowledge work, and search augmentation.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Revenue: USD 50M to 100M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.6
WebsiteLinkedInGlassdoor