PulseAugur
中
实时 19:22:57
English(EN) The System Hallucination Scale (SHS): A Human-Centered Instrument for Assessing Perceived Reliability of Large Language Models

新量表衡量人类对大型语言模型可靠性的感知

研究人员开发了一种新的人本工具,称为系统幻觉量表 (SHS),用于评估用户对大型语言模型可靠性的感知。SHS 借鉴了现有的可用性量表,使用十个李克特量表项来衡量五个维度上的感知可靠性:事实准确性、来源可靠性、逻辑连贯性、呈现欺骗性以及对用户指导的响应性。一项包含 193 名参与者的验证研究表明,SHS 是一个清晰且一致的工具,平均完成时间为 4.2 分钟,并揭示用户认为大型语言模型在来源可追溯性和框架方面比事实准确性更容易出现漏洞。 AI

影响 提供了一种评估大型语言模型感知可靠性的新方法,侧重于用户体验而非原始准确性。

排序理由 该集群描述了一篇介绍用于评估大型语言模型可靠性新量表的新学术论文。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

新量表衡量人类对大型语言模型可靠性的感知

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
该集群描述了一篇介绍用于评估大型语言模型可靠性新量表的新学术论文。
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
paper, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
22 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

  1. arXiv cs.AI TIER_1 English(EN) · Heimo M\"uller, Dominik Steiger, Markus Plass, Andreas Holzinger ·

    系统幻觉量表 (SHS):评估大型语言模型感知可靠性的人本工具

    arXiv:2603.09989v2 Announce Type: replace-cross Abstract: Large language models routinely produce factually incorrect or misleading outputs, yet conventional automated benchmarks overlook how users perceive reliability during interaction. We introduce the System Hallucination Sca…