English(EN) Ranked by the Matcher: A Reproducibility Audit of Knowledge Graph Extraction from Threat Reports

可复现性审计揭示威胁报告知识图谱提取不一致性

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-03 04:00

一项新的研究论文检查了威胁报告知识图谱提取的可复现性，强调了系统如何将预测的三元组与黄金标注进行匹配方面存在不一致性。研究发现，声明的匹配规则只能在检查系统的一小部分中重新实现，并且在不同协议下重新评分输出会改变成对排序。一个LLM裁判在与人类裁决的一致性方面高于机械匹配器，并且开发了一个名为CTIForge的新管道来隔离组件效应，揭示了验证层根据骨干网是托管还是离线，对精度的影响不同。 AI

影响强调了在用于威胁情报的AI系统中标准化评估和验证的必要性，影响了安全分析的可靠性。

排序理由该集群包含一篇详细审计知识图谱提取系统的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 22 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇详细审计知识图谱提取系统的研究论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, safety; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Safayat Bin Hakim, Houbing Herbert Song · 2026-09-03 04:00

匹配器排名：威胁报告知识图谱提取的可复现性审计

arXiv:2609.01671v1 Announce Type: cross Abstract: Security teams and researchers choose knowledge-graph extraction tooling for threat reports on the strength of published triple-F1 scores, yet those scores depend on how predicted triples are matched to gold annotations. We could …

本文如何被排名

报道来源 [1]

匹配器排名：威胁报告知识图谱提取的可复现性审计

相关实体

相关话题