New metric predicts language processing costs beyond surprisal

Researchers have introduced a new metric called trajectory extrapolation error to better predict human language processing costs. This metric analyzes the trajectory of hidden states in transformer language models, going beyond traditional surprisal measures. The findings indicate that this new metric independently predicts reading times and is particularly effective for complex sentence structures, strengthening with larger model scales. AI

IMPACT Introduces a novel metric for understanding language model behavior and its relation to human cognition.

RANK_REASON The cluster contains an academic paper detailing a new research finding and metric. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• GPT-2
• Pythia
• trajectory extrapolation error
• transformer language model

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →