Kohei Kajikawa

LMs' context window size impacts sentence comprehension, study finds

Researchers have explored how Large Language Models (LLMs) like GPT-2 can model human sentence comprehension by examining the impact of context window size and coreference. Their findings indicate a U-shaped relationshi…