Member of Technical Staff - Multimodal Understanding

X AI
Palo Alto
Workplace: OnsiteFull timeUSD 180,000 - 440,000 annuallyFunction: Software EngineeringSkills: ["Communication","Collaboration","Problem-solving","Adaptability"]

Join the multimodal team to push toward superhuman multimodal intelligence by advancing understanding and generation across images, video, audio and text. You will design, build, and optimize large-scale distributed systems for pre-training, post-training, and inference, while collaborating with cross-functional teams to deliver frontier capabilities in multimodal reasoning, world modeling, tool use, and interactive human–AI collaboration.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
X AI
X AI
3 months ago

Member of Technical Staff - Multimodal Understanding

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 4 hours agoStatus: Live

Job Summary

Join the multimodal team to push toward superhuman multimodal intelligence by advancing understanding and generation across images, video, audio and text. You will design, build, and optimize large-scale distributed systems for pre-training, post-training, and inference, while collaborating with cross-functional teams to deliver frontier capabilities in multimodal reasoning, world modeling, tool use, and interactive human–AI collaboration.
Location: Palo Alto
Workplace: Onsite
Employment Type: Full time
Job Function: Software Engineering

Key Responsibilities

  • •Design, build, and optimize large-scale distributed systems for multimodal pre-training, post-training, inference, data processing, and tokenization at web/petabyte scale.
  • •Develop high-throughput pipelines for data acquisition, preprocessing, filtering, generation, decoding, loading, crawling, visualization, and management (images, videos, audio + text).
  • •Advance multimodal capabilities including spatial-temporal compression, cross-modal alignment, world modeling, reasoning, emergent abilities, audio/image/video understanding & generation, real-time video processing, and noisy data handling.
  • •Drive data quality and studies: curation (human/synthetic), filtering techniques, analysis, and scalable pipelines to support trillion-parameter models.
  • •Create evaluation frameworks, internal benchmarks, reward models, and metrics that capture real-world usage, failure modes, interactive dynamics, and human-AI synergy.

Pay and Benefits

Salary: USD 180,000 - 440,000 annually
Equity and Bonus:Equity
Perks:EquityMedicalVisionDental401kDisability

Key Requirements

  • •Hands-on experience with multimodal pre-training, post-training, or fine-tuning (vision, audio, video, or cross-modal).
  • •Expert-level proficiency in Python (core language), with strong experience in at least one of: JAX / PyTorch / XLA.
  • •Proven track record building or optimizing large-scale distributed ML systems (training/inference optimization, GPU utilization, multi-GPU/TPU setups, hardware co-design).
  • •Deep experience designing and running data pipelines at scale: curation, filtering, generation, quality studies, especially for noisy/real-world multimodal data.
  • •Strong fundamentals in evaluation design, benchmarks, reward modeling, or RL techniques (particularly for interactive/agentic behaviors).
Experience:MultimodalAIMLDistributed systemsVisionAudioVideo
Skills:CommunicationCollaborationProblem-solvingAdaptability
Languages:English
Tech Stack:PythonJAXPyTorchXLARustSparkRayKubernetesGPUTPUCUDATokenizersDistributed systems

Company Brief

X AI
Develops advanced artificial intelligence models and research aimed at building safe, general AI and understanding the fundamental nature of the universe. Focuses on large-scale AI systems, research publications, and building foundational AI capabilities.
Industry: AI & Machine Learning
Company Size: Medium (51 to 250 employees)
Growth: Early Stage Startup
Headquarters: San Francisco, United States
Founded: 2023
Website