English(EN) A Validated Dataset and Benchmark for Coherent Multi-Diagram SysML Models

新的基准测试LLM生成相干SysML图的能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-07 04:00

研究人员开发了SEMAADB，这是一个新的数据集和基准，旨在评估大型语言模型生成相干SysML图集的能力。该数据集包含3000个工程上下文，每个上下文有五个相互关联的SysML视图，并包含一个包含100个上下文的人工验证基准测试集。对三个语言模型的评估显示，虽然语法修复已基本解决，但语义修复和在多个图之间保持一致性仍然是当前模型面临的重大挑战。 AI

影响这项研究突显了LLM在生成语义一致且相干的多图系统方面的现有局限性，指明了未来发展的方向。

排序理由该集群包含一篇研究论文，详细介绍了用于评估LLM在SysML图生成方面能力的新数据集和基准。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 19 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇研究论文，详细介绍了用于评估LLM在SysML图生成方面能力的新数据集和基准。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, product; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.AI TIER_1 English(EN) · Ardalan Aryashad, Yan Jin · 2026-10-07 04:00

面向连贯多图SysML模型的已验证数据集和基准测试

arXiv:2610.07356v1 Announce Type: cross Abstract: Systems engineers use several diagrams to describe the structure and behavior of systems. Engineers create these diagrams together to make sure that they use the same elements and remain consistent with one another. Large language…

本文如何被排名

报道来源 [1]

面向连贯多图SysML模型的已验证数据集和基准测试

相关实体

相关话题