Habib Irani

New research questions superposition in Transformers for time series forecasting

Researchers have investigated the internal representations of transformer models used for time series forecasting, finding that complex mechanisms like superposition are not necessary for competitive performance. Studie…