Researchers have introduced STRUCTURALCOST, a new dataset designed to measure human sentence processing difficulty, particularly focusing on long-distance subject-verb dependency resolution. The dataset, comprising 475 participants and 40,800 observations, reveals that human reading times increase with dependency length, influenced by syntactic embedding rather than just linear distance. While various language models, including n-gram, SSM, and transformer architectures, partially replicate this difficulty profile, they underestimate the integration cost experienced by humans, suggesting they capture predictive aspects but not the full working memory integration cost. AI
IMPACT Provides data to better evaluate the cognitive plausibility of language models and improve their understanding of human sentence processing.
RANK_REASON The cluster contains an academic paper detailing a new dataset for NLP research. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →