Researchers have identified a critical issue in time series foundation models (TSFMs) where standard mixture-of-experts (MoE) adaptations fail due to "normalization-induced routing collapse." This phenomenon occurs because pre-encoder normalization strips essential statistical information needed for routers to differentiate between data regimes. The proposed solution, Raw-Routed Mixture of Adapters (RR-MoA), intervenes by routing on the raw, pre-normalization input, effectively bypassing this collapse. Experiments show RR-MoA significantly outperforms existing adapter methods and even full fine-tuning when using a frozen backbone, a result termed the "Frozen Paradox." AI
IMPACT Introduces a novel adapter technique that improves performance and efficiency in time series foundation models by addressing a specific routing collapse issue.
RANK_REASON Academic paper detailing a new method for time series foundation models. [lever_c_demoted from research: ic=1 ai=1.0]
- AdaMix
- instance-normalized backbones
- LoRA+
- normalization-induced routing collapse
- Raw-Routed Mixture of Adapters
- RR-MoA
- Spearman
- Time Series Foundation Models
- Trace
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →