Research Scientist / Engineer — Foundation Model (Agent)

Luma
Redwood City
Workplace: HybridFull timeFunction: Data Science & Machine LearningSkills: []

Build and train large-scale multimodal agentic foundation models that reason, plan, code, and call tools to complete complex multi-step tasks. Own the modeling and engineering stack end-to-end: design data pipelines for massive pixel datasets, train on large multimodal sets across GPU clusters, and create novel evaluation frameworks to measure agent performance. The role spans modeling, data, systems, and evaluation on new problems with no existing playbook.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
Luma
Luma
2 weeks ago

Research Scientist / Engineer — Foundation Model (Agent)

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 6 hours agoStatus: Live

Job Summary

Build and train large-scale multimodal agentic foundation models that reason, plan, code, and call tools to complete complex multi-step tasks. Own the modeling and engineering stack end-to-end: design data pipelines for massive pixel datasets, train on large multimodal sets across GPU clusters, and create novel evaluation frameworks to measure agent performance. The role spans modeling, data, systems, and evaluation on new problems with no existing playbook.
Location: Redwood City
Workplace: Hybrid
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Architect large-scale multimodal agentic models that use reasoning, planning, coding, and tool calling for complex multi-step work.
  • •Design, build, and run robust data pipelines to construct, enrich, and filter massive pixel datasets and formulate new tasks.
  • •Train large-scale multimodal models on massive datasets and GPU clusters.
  • •Define and build novel evaluation frameworks to measure multimodal agents.

Key Requirements

  • •Strong foundation in machine learning, foundation models, and agentic systems.
  • •Deep understanding of agentic systems and LLM/VLM reasoning, coding models, and tool calling.
  • •Hands-on PyTorch and large-scale training (distributed, mixed precision, large datasets).
  • •Experience with state-of-the-art foundation models in reasoning, coding, or tool calling, or state-of-the-art multimodal agents.
Experience:Foundation modelsAgentic systemsMultimodalGPU trainingDistributed training
Tech Stack:PyTorchGPUDistributed trainingMixed precision

Company Brief

Luma
Develops AI-powered tools for capturing, editing, and rendering high-quality 3D scenes from photos and videos, enabling creators to generate photorealistic 3D assets and spatial experiences.
Industry: AR/VR & Spatial Computing
Website