Researchers have developed a method for fusing multimodal sensor data, specifically for recognizing breathing activity and pose. The approach utilizes frozen V-JEPA2 features transferred to heterogeneous sensors including RGB video, depth video, and radar time series. A shared fusion model employs modality queries and explicit sensor availability to classify these activities across various sensor subsets, demonstrating controlled evaluations of subset supervision and representation transfer. AI
IMPACT This research could lead to more robust and accurate systems for monitoring physiological and movement data, with applications in healthcare and human-computer interaction.
RANK_REASON The cluster contains an academic paper detailing a new method for sensor fusion and activity recognition. [lever_c_demoted from research: ic=1 ai=1.0]
- alphaXiv
- arXiv
- CatalyzeX
- Consensus-JEPA
- Constantino Álvarez Casado
- DagsHub
- Gotit.pub
- Hugging Face
- Influence Flower
- OMuSense-23
- ScienceCast
- V-JEPA2
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →