Research Scientist, HCI-Multimodality - Interaction Perception, PICO

ByteDance
San Jose
Workplace: OnsiteFull timeFunction: Data Science & Machine LearningExperience: 5+ yearsSkills: ["Technical leadership"]

Join the PICO team to build next-generation VR interaction perception powered by computer vision and multimodal deep learning. You’ll develop VR intelligent input algorithms, create LLM/NLP models for prediction and error correction, and research lightweight multimodal fusion for interactive systems. The role includes delivering technical innovations and patents and providing technical leadership to an algorithm team.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

Research Scientist, HCI-Multimodality - Interaction Perception, PICO

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 31 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Join the PICO team to build next-generation VR interaction perception powered by computer vision and multimodal deep learning. You’ll develop VR intelligent input algorithms, create LLM/NLP models for prediction and error correction, and research lightweight multimodal fusion for interactive systems. The role includes delivering technical innovations and patents and providing technical leadership to an algorithm team.
Location: San Jose
Workplace: Onsite
Employment Type: Full time
Job Function: Data Science & Machine Learning
Seniority: Mid level

Key Responsibilities

  • •Develop computer vision-driven VR interaction algorithms for intelligent input method systems.
  • •Build LLM & NLP algorithms for prediction, error correction, and completion.
  • •Research lightweight LLM/NLP and vision-language multimodal fusion approaches for VR.
  • •Deliver technical innovations, patents, and translate research into usable outcomes.
  • •Provide technical leadership for the algorithm team.

Key Requirements

  • •Master’s/PhD in Computer Science, AI, or a related field.
  • •5+ years of NLP/LLM R&D experience, with 2+ years leading core algorithms.
  • •Expertise in Transformers, LLMs, and sequence modeling.
  • •Proficiency with PyTorch or TensorFlow.
  • •Basic computer vision or multimodal background.
Experience:5+ yearsNLPLLMR&DComputer visionMultimodalVR
Education:
Skills:Technical leadership
Tech Stack:Computer visionDeep learningSLAM3D reconstructionMulti-sensor fusionNLPLLMTransformersSequence modelingPyTorchTensorFlowVision-language multimodal fusionLLM fine-tuningLightweight modelsModel deploymentEdge devicesVR interaction

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn