cosine-kernel attention

Lévy Attention introduces single-pass predictive uncertainty for time series

Researchers have introduced Lévy Attention, a novel attention mechanism designed for irregularly sampled time series data. This new approach integrates predictive uncertainty directly into the attention layer, allowing …