Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)

Perplexity
Belgrade, London, Berlin
Full timeFunction: Administration & Executive AssistanceExperience: 3+ yearsSkills: ["Ownership","Clean code","Scalability mindset","Problem-solving","Attention to trade-offs"]

Build foundational search core components for high-scale indexing and data pipelines. Design and implement streaming and batch data processing for search index construction, along with retrieval algorithms and ranking systems. Optimize performance through low-level systems tuning, multithreading, and concurrency work, and operate hardware-adjacent, distributed services that scale to billions of pages. Collaborate on end-to-end lifecycle: design, deployment, operations, and scaling in production.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Perplexity
Perplexity
13 hours ago

Member of Technical Staff (Search Core, Indexing & Data Pipeline Stream)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 13 hours agoStatus: Live

Job Summary

Build foundational search core components for high-scale indexing and data pipelines. Design and implement streaming and batch data processing for search index construction, along with retrieval algorithms and ranking systems. Optimize performance through low-level systems tuning, multithreading, and concurrency work, and operate hardware-adjacent, distributed services that scale to billions of pages. Collaborate on end-to-end lifecycle: design, deployment, operations, and scaling in production.
Location: Belgrade, London, Berlin
Employment Type: Full time
Job Function: Administration & Executive Assistance
Seniority: Mid level

Key Responsibilities

  • •Design and build core search engine components, especially indexing pipelines and data storage formats at billions-of-pages scale.
  • •Develop streaming and batch data processing systems for search index construction in high-load environments.
  • •Optimize hardware performance using low-level optimizations and systems-level tuning.
  • •Address multithreading, concurrency, and system-level performance challenges.
  • •Build end-to-end retrieval functionality including indexing pipelines, retrieval algorithms, and ranking systems.

Key Requirements

  • •3+ years of hands-on systems programming experience in Rust, C++, C, or similar languages.
  • •Own the full project lifecycle, from design and deployment to operation and production scaling.
  • •Knowledge of Python or other scripting languages.
  • •Experience with data processing systems such as YT, Kafka, or Hadoop.
  • •Strong multithreading/concurrency skills and deep understanding of algorithms, data structures, and systems-level optimization.
Experience:3+ years
Skills:OwnershipClean codeScalability mindsetProblem-solvingAttention to trade-offs
Tech Stack:RustC++CPythonYTKafkaHadoopLinuxAWSKubernetesSIMDProfiling

Company Brief

Perplexity
Perplexity AI provides an AI-powered answer engine that returns conversational, citation-backed answers to user queries and offers Pro/Enterprise products and APIs for research, knowledge work, and search augmentation.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Revenue: USD 50M to 100M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.6
WebsiteLinkedInGlassdoor