研究人员开发了一个新的框架来评估仇恨言论检测模型，重点关注人类解释（rationales）的多样性，而不仅仅是多数投票。该研究提出按预测和分布属性组织分类指标，并按合理性、忠实性和复杂性组织可解释性指标。结果表明，标签和解释的软表示在捕捉主观 NLP 任务中的人类分歧和推理风格方面更有效。 AI
影响 引入了一个新颖的 NLP 模型评估框架，有可能提高仇恨言论检测系统的鲁棒性和公平性。
排序理由 该集群包含一篇学术论文，详细介绍了评估 NLP 模型的新方法。
AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →
arXiv:2605.31563v1 Announce Type: new Abstract: Human disagreement is ubiquitous and well-known in labeling. However, variation in explanations, captured through token-level human rationales, remains far less explored. At the same time, it is unclear how to best evaluate human la…
Human disagreement is ubiquitous and well-known in labeling. However, variation in explanations, captured through token-level human rationales, remains far less explored. At the same time, it is unclear how to best evaluate human labels and rationales -- or even how to best aggre…