Researchers have developed HART, a novel time series foundation model that combines attention and RWKV blocks to improve long-horizon forecasting. The model addresses the degradation observed in pure RWKV models when predicting far into the future without new data, a phenomenon they term Placeholder Idling Decay (PID). Experiments on GIFT-Eval and TIME-Benchmark demonstrate that HART outperforms pure RWKV and matches the performance of a much larger Transformer model on certain metrics, while using significantly fewer parameters. AI
IMPACT Introduces a new architecture that could improve long-horizon forecasting accuracy and efficiency in time series analysis.
RANK_REASON The cluster describes a new research paper detailing a novel model architecture for time series forecasting. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- GIFT-Eval
- HART
- Hugging Face
- Placeholder Idling Decay
- RWKV-7
- TIME-Benchmark
- Toto-2.0-1B
- Transformer
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →