Delta-rule models

Kalman Delta Networks enhance language models with uncertainty-aware memory

Researchers have introduced Kalman Delta Networks (KDNs), a new family of models designed to enhance associative memory in language models by incorporating uncertainty awareness. These networks reformulate recurrent ass…