PulseAugur
中
实时 23:45:34
English(EN) SciHazard: A Benchmark for Measuring Scientific Safety Risks with Decomposed Harm Scoring

新基准SciHazard衡量大型语言模型科学安全风险

研究人员推出了一款名为SciHazard的新基准,旨在评估大型语言模型(LLMs)在科学领域相关的安全风险。该基准包含12个学科的2400个危险问题和600个过度安全问题,这些问题基于现实世界的危险和已记录的失败场景。SciHazard采用一种名为DeHarm-Score的分解伤害评分方法,该方法评估查询的严重性、拒绝行为以及响应级别的风险,包括可执行性和净新风险。初步评估表明,深度研究代理比标准LLMs带来更大的安全风险,这凸显了当前AI安全防御中的一个关键漏洞。 AI

影响 凸显了自主AI代理中一个关键的安全盲点,可能影响未来的AI安全研究和开发。

排序理由 该集群描述了一篇介绍AI安全新基准和评估框架的学术论文。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

新基准SciHazard衡量大型语言模型科学安全风险

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群描述了一篇介绍AI安全新基准和评估框架的学术论文。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
89 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Chunxiao Li, Yuan Xiong, Lijun Li, Tianyi Du, Wenlong Zhang, Lei Bai, Jing Shao ·

    SciHazard:一个用于衡量科学安全风险并进行分解伤害评分的基准测试

    arXiv:2607.18665v1 Announce Type: new Abstract: Large language models (LLMs) increasingly support science, but they can also convert hazardous scientific knowledge into actionable misuse guidance. Existing benchmarks often rely on templated queries disconnected from real-world ha…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    SciHazard:一个用于衡量科学安全风险并进行分解伤害评分的基准测试

    Large language models (LLMs) increasingly support science, but they can also convert hazardous scientific knowledge into actionable misuse guidance. Existing benchmarks often rely on templated queries disconnected from real-world hazards, and employ LLM-as-a-Judge paradigms witho…