STM3: Mixture of Multiscale Mamba for Long-Term Spatio-Temporal Time-Series Prediction
Researchers have introduced STM3, a novel Mixture-of-Experts framework designed to enhance long-term spatio-temporal time-series prediction. This approach integrates a Multiscale Mamba architecture with a Disentangled Mixture-of-Experts (DMoE) to efficiently capture diverse multiscale information. STM3 also employs an adaptive graph causal network to model complex spatial dependencies and uses a stable routing strategy with causal contrastive learning for robust representation. Experiments on ten real-world benchmarks show STM3 achieving state-of-the-art results, outperforming previous models significantly on datasets like PEMSD8. AI
IMPACT Advances capabilities in complex time-series forecasting, potentially improving applications in areas like climate modeling and traffic prediction.