AI Algorithm Expert - Hand Tracking, PICO - San Jose

ByteDance
San Jose
Full timeFunction: Data Science & Machine LearningExperience: 5+ yearsEducation: high_schoolSkills: ["Research","Optimization","Algorithm R&D"]

Develop high-precision, low-latency hand-tracking algorithms for XR using computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion. Build robust 3D gesture pose estimation models for challenging conditions, and optimize real-time on-device inference on mobile XR headsets for millimeter-level accuracy. Lead multimodal interaction algorithm frameworks and support technical impact through patents and publications.

Loading

Loading job details...

Preparing the role view and application actions.

FursaFursa
ByteDance
ByteDance
1 month ago

AI Algorithm Expert - Hand Tracking, PICO - San Jose

✓ Verified Job

Canonical indexed version, validated from employer's careers page.

Source: Company careers pageValidated by: Fursa AI
Last checked: 30 days agoStatus: Live
Reposted: similar role first listed 1 month ago

Job Summary

Develop high-precision, low-latency hand-tracking algorithms for XR using computer vision, deep learning, SLAM, 3D reconstruction, and multi-sensor fusion. Build robust 3D gesture pose estimation models for challenging conditions, and optimize real-time on-device inference on mobile XR headsets for millimeter-level accuracy. Lead multimodal interaction algorithm frameworks and support technical impact through patents and publications.
Location: San Jose
Employment Type: Full time
Job Function: Data Science & Machine Learning

Key Responsibilities

  • •Lead development of high-precision, low-latency hand-tracking algorithms in XR, including monocular/multiple vision and multi-sensor fusion.
  • •Build robust 3D gesture pose estimation models for extreme scenarios such as occlusion, fast motion, and complex illumination.
  • •Optimize real-time inference performance on a mobile XR headset to achieve millimeter-level tracking accuracy.
  • •Lead construction of multimodal machine learning interaction frameworks (hand + eye movement + peripheral device) for natural XR interaction patterns.
  • •Promote patent layout and publication of papers in accredited conferences (CVPR/ICCV/SIGGRAPH) to enhance technical influence.

Key Requirements

  • •Majored in Computer Vision, Pattern Recognition, or Applied Mathematics, with more than 5 years of experience in algorithm R&D.
  • •Familiar with technical principles and tradeoffs of commercial solutions such as ARKit Hand Tracking and Quest Hand Tracking.
  • •Proficient in the PyTorch framework and QNN deployment ecosystem, with practical experience optimizing with TensorRT end-side.
  • •Experience developing core HandTracking algorithms for XR products.
  • •Published papers on gesture tracking in accredited conferences such as CVPR/ICCV/SIGGRAPH.
Experience:5+ years
Education:High School in Computer Vision, Pattern Recognition or Applied Mathematics
Skills:ResearchOptimizationAlgorithm R&D
Tech Stack:PyTorchQNNTensorRTARKitQuest Hand Tracking3D reconstructionSLAMComputer visionDeep learningMulti-sensor fusion

Company Brief

ByteDance
Develops consumer internet and content platforms, including TikTok and other apps for short-form video, news, and entertainment. It also builds advertising, commerce, and creator tools that connect audiences, brands, and publishers across global markets.
Industry: Digital Media
Company Size: Enterprise (1,001+ employees)
Revenue: USD 1B+
Growth: Established Company
Headquarters: Beijing, China
Founded: 2012
WebsiteLinkedIn