Dynamic TMoE: A Drift-Aware Dynamic Mixture of Experts Framework for Non-Stationary Time Series Forecasting
Researchers have developed Dynamic TMoE, a novel framework designed to improve non-stationary time series forecasting. This approach addresses the limitations of existing Mixture-of-Experts (MoE) models by dynamically adjusting the expert pool and incorporating temporal memory for routing. The system detects distribution shifts using Maximum Mean Discrepancy (MMD) to instantiate and prune experts, optimizing model capacity. Experiments show Dynamic TMoE achieves state-of-the-art results, significantly reducing Mean Squared Error (MSE) and Mean Absolute Error (MAE) across nine benchmarks. AI
IMPACT Enhances time series forecasting capabilities, potentially improving applications in finance, weather, and demand prediction.