English(EN) QSTRBench: a New Benchmark to Evaluate the Ability of Language Models to Reason with Qualitative Spatial and Temporal Calculi

新的QSTRBench基准测试评估LLM的时空推理能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-05-18 13:26

研究人员推出了QSTRBench，这是一个旨在评估大型语言模型定性时空推理能力的新基准测试。该基准测试包含多种演算，如点代数、Allen区间代数和区域连接演算，其中一些演算（如RCC-22）是首次发布。虽然当前前沿模型表现超出随机水平，但没有模型能够始终正确回答所有问题，不同演算之间的难度差异很大。 AI

影响引入了一个新的评估框架，以更好地理解和改进LLM在复杂推理任务中的能力。

排序理由该集群包含一篇介绍用于评估LLM的新型基准测试的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍用于评估LLM的新型基准测试的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 138 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Robert E. Blackwell · 2026-05-18 13:26

QSTRBench：评估语言模型在定性时空演算推理能力的新基准

We introduce an extensive qualitative spatial and temporal reasoning (QSTR) benchmark for evaluating large language models (LLMs). We pose questions concerning compositional reasoning (using composition tables, CT), converse relations, and conceptual neighbourhoods (CN) for QSTR …

本文如何被排名

报道来源 [1]

QSTRBench：评估语言模型在定性时空演算推理能力的新基准

相关实体

相关话题