English(EN) BANGLAPLAN: A Benchmark for Constraint-Based Planning and Decision-Making in Bangla

新的BANGLAPLAN基准测试评估孟加拉语LLM规划能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-10-15 04:00

一个名为BANGLAPLAN的新基准测试已被开发出来，用于评估大型语言模型在孟加拉语中进行基于约束的规划和决策的能力。该基准测试包含十个任务家族的1000个问题，旨在反映孟加拉国的现实生活场景，并涵盖各种语言风格和答案格式。初步评估显示，GPT-6.1 Sol等领先模型（准确率达到98.7%）与其他模型之间存在显著的性能差距，许多模型的得分低于简单的基线。 AI

影响该基准测试将能够更好地评估LLM在孟加拉语等代表性不足的语言中执行复杂推理和规划任务的能力。

排序理由该集群描述了一个用于评估LLM在特定语言和任务领域能力的新的学术基准测试。[lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 12 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 该集群描述了一个用于评估LLM在特定语言和任务领域能力的新的学术基准测试。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: Breaking (< 6h); Fresh story with cross-source coverage still developing. Ranking may shift as more sources report.

完整方法见我们的编辑标准。

报道来源 [1]

arXiv cs.CL TIER_1 English(EN) · Md Rayhanul Masud, S M Maksudul Alam, Mohammad Jaminur Islam · 2026-10-15 04:00

BANGLAPLAN：孟加拉语中基于约束的规划与决策基准测试

arXiv:2610.19704v1 Announce Type: new Abstract: Large language models (LLMs) increasingly help users arrange appointments, plan journeys, and allocate limited resources. These tasks require models to satisfy constraints on time, cost, capacity, and order, or determine that no fea…

本文如何被排名

报道来源 [1]

BANGLAPLAN：孟加拉语中基于约束的规划与决策基准测试

相关实体

相关话题