Energy-Based Transformers

Energy-based transformers show promise in predicting reading difficulty

Researchers have introduced a new class of transformer models called energy-based transformers, which offer a formal connection to associative memory models. In computational psycholinguistics, this energy measure has b…