Researchers have developed TouchéWorld, a new framework that integrates gesture-driven interaction into a camera-controlled video world model. This system allows users to explore generated environments using continuous hand motions for fine-grained interaction with objects and people. The framework generates video based on user prompts and temporally aligned camera and hand controls, utilizing a combination of spatial hand-skeleton conditioning and numerical hand-motion features. A new benchmark, TouchéBench, has also been introduced to evaluate the system's performance in areas like hand-motion following and online interaction. AI
IMPACT Enables more intuitive and interactive exploration of AI-generated environments through gesture control.
RANK_REASON The cluster contains a research paper detailing a new framework and benchmark. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Connected Papers
- DagsHub
- Gotit.pub
- Hugging Face
- Litmaps
- ScienceCast
- Scite
- TouchéWorld
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →