Masked Visual Actions for Unified World Modeling

Li, Wu introduce TrAct to unify robot control and visual prediction

Researchers, including Fei-Fei Li and Jiajun Wu, have introduced TrAct, a novel approach to bridge the gap between robot control and visual prediction. TrAct utilizes "visual tracks" as an intermediary language, transla…