PulseAugur
中
实时 21:39:04
English(EN) SCRIPTIOC-BENCH: A Benchmark for Recognizing Actionable Threat Intelligence from Script-Based Malware using LLMs

新基准测试LLM从恶意软件中提取威胁情报的能力

研究人员推出了SCRIPTIOC-BENCH,这是一个新的基准测试,旨在评估大型语言模型(LLM)从基于脚本的恶意软件中提取可操作威胁情报的能力。该基准测试包含634个经过验证的JavaScript、PowerShell和VBScript样本,重点关注四种类型的攻击指标(IOCs):URL、域名、IP地址和文件系统伪影。评估显示,即使是表现最好的LLM在静态IOC恢复方面也面临挑战,最高F1分数仅为65.4,凸显了该领域的持续挑战。 AI

影响 该基准测试有望推动LLM在网络安全威胁检测和分析能力方面的改进。

排序理由 该集群描述了一个用于评估LLM在特定安全任务上表现的新学术基准测试,已在arXiv上发布。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

新基准测试LLM从恶意软件中提取威胁情报的能力

本文如何被排名

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
该集群描述了一个用于评估LLM在特定安全任务上表现的新学术基准测试,已在arXiv上发布。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, safety
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
78 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.AI TIER_1 English(EN) · Hanna Kim, Jian Cui, Minkyoo Song, Hwanjo Heo, Seungwon Shin, Kimin Lee, Xiaojing Liao ·

    SCRIPTIOC-BENCH:使用大型语言模型识别基于脚本的恶意软件中的可操作威胁情报的基准测试

    arXiv:2609.06149v1 Announce Type: cross Abstract: Script-based malware remains a prevalent attack technique. These scripts often contain indicators of compromise (IOCs) that provide actionable threat intelligence. However, statically recovering such indicators is challenging, as …

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    SCRIPTIOC-BENCH:使用大型语言模型识别基于脚本的恶意软件中的可操作威胁情报的基准测试

    Script-based malware remains a prevalent attack technique. These scripts often contain indicators of compromise (IOCs) that provide actionable threat intelligence. However, statically recovering such indicators is challenging, as relevant values may be dispersed or transformed wi…