Researchers have developed a novel multimodal sensing architecture for Extended Reality (XR) that integrates 5G MillimeterWave (mmWave) Integrated Sensing and Communication (ISAC) with surface electromyography (sEMG) signals. This system aims to provide real-time avatar control in XR by leveraging existing 5G communication signals for coarse body-level gesture and pose estimation, while sEMG sensors capture fine-grained finger-level movements. Evaluations show that the 5G mmWave ISAC component achieves an average accuracy of 82.2% for body-level gestures, even with users not present during training, and sEMG demonstrates consistent performance for detailed finger interactions. AI
IMPACT This research could enable more natural and intuitive avatar control in XR by integrating existing communication infrastructure with biosensors.
RANK_REASON Academic paper detailing a new technical approach. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
