Member of Technical Staff (Backend Software Engineer, Search Crawler)

Perplexity
Belgrade, Berlin, London
Workplace: HybridFull timeFunction: Software EngineeringExperience: 5+ yearsSkills: ["Ownership","Collaboration","Problem-solving","Communication"]

Experienced Backend Software Engineer to join the Crawler team, designing, developing, and operating web-scale data ingestion, processing, and management systems for advanced search technologies. You’ll work across backend and frontend components of the data acquisition stack, lead large-scale crawler projects, and collaborate with Search and Infrastructure teams to ensure high-load, real-time ingestion and processing.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Perplexity
Perplexity
1 year ago

Member of Technical Staff (Backend Software Engineer, Search Crawler)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 1 hour agoStatus: Live

Job Summary

Experienced Backend Software Engineer to join the Crawler team, designing, developing, and operating web-scale data ingestion, processing, and management systems for advanced search technologies. You’ll work across backend and frontend components of the data acquisition stack, lead large-scale crawler projects, and collaborate with Search and Infrastructure teams to ensure high-load, real-time ingestion and processing.
Location: Belgrade, Berlin, London
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering
Seniority: Sr. Manager level

Key Responsibilities

  • •Take ownership of and lead projects focused on developing large-scale web crawlers, ingestion pipelines, and data processing systems.
  • •Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
  • •Collaborate closely with Search and Infrastructure teams to ensure the reliable, high-quality ingestion and processing of billions of web pages.
  • •Architect and implement fullstack features and scalable distributed systems that handle high-load and real-time data operations.
  • •Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.

Key Requirements

  • •Minimum of 5 years of software development experience with strong knowledge of data structures and algorithms in Python, C++, Rust, or Go.
  • •Experience with large-scale web crawlers is highly desirable.
  • •Proven experience building, deploying, and optimizing high-load, distributed, and hardware-adjacent services.
  • •Deep understanding of cloud infrastructure, with hands-on experience in Kubernetes (K8s) and AWS.
  • •Demonstrated passion for writing clean, efficient, and scalable systems.
Experience:5+ yearsSearchWeb crawlingDistributed systems
Skills:OwnershipCollaborationProblem-solvingCommunication
Languages:English
Tech Stack:PythonC++RustGoKubernetesAWS

Company Brief

Perplexity
Perplexity AI provides an AI-powered answer engine that returns conversational, citation-backed answers to user queries and offers Pro/Enterprise products and APIs for research, knowledge work, and search augmentation.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Revenue: USD 50M to 100M
Growth: Scaleup
Valuation: Unicorn (USD 1B+)
Funding: Series D
Headquarters: San Francisco, United States
Founded: 2022
Glassdoor
Glassdoor: 4.6
WebsiteLinkedInGlassdoor