English(EN) Towards a Benchmark for Fire Safety Code Interpretation in the Hong Kong AEC Industry

大型语言模型在香港消防安全规范解读方面存在困难，新基准揭示

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-15 04:00

一个新基准数据集已被开发出来，用于评估大型语言模型（LLMs）在解读香港消防安全规范方面的表现。研究发现，虽然专有LLMs在多项选择题上达到了80-90%的准确率，但在开放式问题上，经人类专家评估后，其表现下降到50-70%。这表明LLMs在专业的监管合规任务方面存在显著的能力差距。 AI

影响强调了提高LLMs在专业监管合规任务中的准确性的必要性，尤其是在建筑、工程和施工行业。

排序理由该集群包含一篇学术论文，详细介绍了用于评估LLMs在特定领域表现的新基准。[lever_c_demoted from research: ic=1 ai=1.0]

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 21 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群包含一篇学术论文，详细介绍了用于评估LLMs在特定领域表现的新基准。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

arXiv cs.AI TIER_1 English(EN) · Le Qiu, Zhuan Anne Zhang, Hok Ming Adeline Chan, Emmanuele Chersoni · 2026-10-15 04:00

香港建筑、工程和施工行业消防安全规范解读基准的探索

arXiv:2610.16127v1 Announce Type: cross Abstract: Large Language Models (LLMs) are increasingly explored in the Architecture, Engineering, and Construction (AEC) domain, yet their reliability in regulatory compliance remains uncertain. In this study, we evaluate the performance o…