Track4Action: Distilling World-Centric 3D Tracker into Vision-Language-Action Policies

Published
Source
arXiv
Paper number
817
Field
Robotics
arXiv ID
2608.03727

Key points

  • It proposes a privileged-supervision approach in which a 3D tracker is used only during training and removed at deployment.
  • Track queries match the 3D tracker features extracted from Track4World and inject them into the VLA action head.
  • It reaches 82.3 percent zero-shot on LIBERO-Plus, improving by 7.6 percentage points over the unaligned version and by 3.0 points over LaMP.
  • It records 80.44 percent on RoboTwin 2.0 clean and 81.48 percent on randomized.
  • On four real dual-arm robot tasks, it reaches 67.5 percent, which is 25.0 percentage points higher than the unaligned version.

Paper links

External research summaries. These are not HDATF publications or measured product results.

Read original (opens in a new tab)