English(EN) Before You Continue: Evaluating Time-Sensitive Safety Awareness in Conversational Assistants

新的TASC基准揭示LLM助手在时效性安全方面存在困难

作者 PulseAugur 编辑部 · [1 个来源] · 2026-11-05 05:00

一个名为TASC的新基准已被开发出来，用于评估对话式AI助手在时效性安全方面的意识。该基准包含超过3400个输入和33个场景，用于测试LLM是否能够识别并根据时间依赖性约束调整其建议，即使在对话后期用户没有明确提及。对13个模型的初步测试显示，助手仅在约30.5%的相关案例中考虑了这些约束，并且在正确计算经过时间的情况下，仍有62.1%的实例未能应用这些约束。 AI

影响这项研究突显了LLM安全方面的一个关键差距，表明需要改进对话代理中的时间推理和应用能力。

排序理由该集群包含一篇介绍LLM能力评估新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 26 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇介绍LLM能力评估新基准的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CL TIER_1 English(EN) · Peidi Dong, Yunze Xiao, Yu-Lin Tsai, Yichen Zheng, Heyuan Huang, Weihao Xuan, Mark Dredze, Jen-tse Huang · 2026-11-05 05:00

继续之前：评估对话式助手中的时效性安全意识

arXiv:2611.06839v1 Announce Type: new Abstract: Large language model (LLM) assistants increasingly help users with everyday activities that involve time-dependent constraints. However, users may not mention these constraints in later requests, requiring assistants to recognize an…

本文如何被排名

报道来源 [1]

继续之前：评估对话式助手中的时效性安全意识

相关实体

相关话题