Efficient Temporal Modeling for Mobile Sleep Staging via Lightweight Random Attention
Researchers have developed a new temporal modeling module called Random Attention (RA) designed for efficient sleep staging on mobile devices. RA utilizes fixed random projections for similarity-based aggregation, reducing computational cost compared to traditional sequential models like RNNs and Transformers. Theoretical analysis via the Random Attention Prior Kernel (RAPK) decomposes RA into global smoothing and feature similarity terms, offering interpretability. Experiments on benchmark datasets demonstrated that RA improves accuracy and F1 scores by 1-3% over baseline methods while maintaining competitive performance and showing strong generalization and robustness. AI
IMPACT This research introduces a more efficient method for AI-powered sleep staging, potentially enabling real-time analysis on wearable devices.