PulseAugur
EN
LIVE 08:37:42

Collection dates significantly degrade temporal QA performance in LLMs

By PulseAugur Editorial · [1 sources] ·

A new research paper published on arXiv explores the impact of collection dates on temporal question answering (QA) systems. The study found that assigning collection dates, which indicate when a source was acquired rather than when its content changed, significantly degrades QA performance. Swapping question dates between revisions led to substantial drops in exact match scores across multiple large language models, even with prompt variations designed to mitigate the effect. The research highlights a critical vulnerability in temporal QA systems and suggests a need for better metadata handling. AI

IMPACT Highlights a critical vulnerability in temporal QA systems, potentially impacting how LLMs process and retrieve time-sensitive information.

RANK_REASON Research paper published on arXiv detailing findings about temporal QA systems. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Collection dates significantly degrade temporal QA performance in LLMs

How we ranked this

Signal score
18 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Research paper published on arXiv detailing findings about temporal QA systems. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, model release
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Breaking (< 6h)
Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

Full methodology in our editorial standards.

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Minsu Oh, Seunghui Jwa, Soo Kyun Kim, Yeo-Chan Yoon ·

    Collection-Date Assignment Redirects Answers in Temporal QA

    arXiv:2610.32191v1 Announce Type: new Abstract: A collection date records when a source revision was acquired, not when its contents changed. Can assigning this metadata redirect temporal question answering despite unchanged evidence? Swapping the question day and following day b…

RELATED ENTITIES

RELATED TOPICS