Software Engineer - Data Platform

X AI
Palo Alto, San Francisco
Workplace: HybridFull timeUSD 180,000 - 440,000 annuallyFunction: Software EngineeringSkills: ["Communication","Collaboration","Problem-solving","Teamwork","Attention to detail"]

Software Engineer on the Data Platform team designing, building, and operating distributed systems that move and process trillions of events daily. You’ll own infrastructure powering real-time ML pipelines and analytics, work with Kafka/HDFS/Spark/Flink/Trino, and collaborate with ML, product, and infra teams to ensure high throughput, low latency, and reliability at petabyte scale.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
X AI
X AI
1 year ago

Software Engineer - Data Platform

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 20 hours agoStatus: Live

Job Summary

Software Engineer on the Data Platform team designing, building, and operating distributed systems that move and process trillions of events daily. You’ll own infrastructure powering real-time ML pipelines and analytics, work with Kafka/HDFS/Spark/Flink/Trino, and collaborate with ML, product, and infra teams to ensure high throughput, low latency, and reliability at petabyte scale.
Location: Palo Alto, San Francisco
Workplace: Hybrid
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design and implement high-throughput, low-latency data ingestion and transport systems.
  • •Scale and optimize multi-tenant Kafka infrastructure supporting real-time workloads.
  • •Extend and tune Spark, Flink, and Trino for demanding production pipelines.
  • •Build interfaces, APIs, and pipelines enabling teams to query, process, and move data at petabyte scale.
  • •Debug and optimize distributed systems, with a focus on reliability and performance under load.

Pay and Benefits

Salary: USD 180,000 - 440,000 annually
Equity and Bonus:Equity
Perks:EquityMedicalVisionDental401kLife InsuranceDisability

Key Requirements

  • •Distributed systems expertise and experience with large-scale data platforms
  • •Proficiency in Rust, Go, Scala, or similar systems languages; production experience with Kafka, Flink, Spark, Trino, or Hadoop
  • •Strong debugging, profiling, and performance optimization skills
  • •Track record of shipping and maintaining critical infrastructure
  • •Comfortable working in fast-moving, high-stakes environments with minimal guardrails
Experience:Data platformsDistributed systemsKafkaSparkFlinkTrinoHadoop
Skills:CommunicationCollaborationProblem-solvingTeamworkAttention to detail
Languages:English
Tech Stack:RustGoScalaKafkaFlinkSparkTrinoHadoopHDFSApache KafkaKubernetesDocker

Company Brief

X AI
Develops advanced artificial intelligence models and research aimed at building safe, general AI and understanding the fundamental nature of the universe. Focuses on large-scale AI systems, research publications, and building foundational AI capabilities.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Early Stage Startup
Headquarters: San Francisco, United States
Founded: 2023
Website