COMPASS: Complete Multimodal Fusion via Proxy Tokens and Shared Spaces for Ubiquitous Sensing
Researchers have developed COMPASS, a novel framework designed to enhance multimodal sensing by addressing the challenge of missing data modalities. This system ensures a consistent fusion interface by using proxy tokens to fill in absent modalities with estimated representations derived from the observed ones. COMPASS demonstrates improved robustness across various datasets and missing modality scenarios, outperforming traditional imputation and translation-based methods. AI
IMPACT Enhances robustness in multimodal AI systems by providing a consistent method for handling missing data during fusion.