James Michaelov

N-gram models better predict reading time than transformers, study finds

A new paper proposes that traditional n-gram language models may be better predictors of naturalistic reading time than complex transformer models. The research suggests that while transformers excel at next-word predic…