PulseAugur
中
实时 12:40:09
English(EN) Alice: A Large-Scale German Benchmark for Rubric-Based Multi-Dimensional Automatic Short Answer Scoring

新的大语言模型框架和基准推动自动短答案评分发展

作者 PulseAugur 编辑部 · [2 个来源] ·

两篇新的研究论文介绍了使用大语言模型（LLMs）进行自动短答案评分（ASAS）的新颖框架。第一篇论文RUSPAN将评分标准描述视为语义标签表示，并将问题上下文、学生答案和评分标准级别序列化为单个序列进行评分。它还引入了一个与评分标准无关的掩码（RIM），以提高跨不同评分标准集的零样本迁移能力。第二篇论文Alice提出了一个大规模德语基准，用于基于评分标准的ASAS，侧重于学习表现、知识要素和技能，并对各种语言模型进行了基准测试，指出LLMs在知识要素和技能的零样本评分方面存在困难。 AI

影响 这些进展可以提高自动评分系统的效率和准确性，有可能为教育工作者腾出时间来处理更复杂的任务。

排序理由 两篇发表在arXiv上的研究论文，介绍了自动短答案评分的新方法和基准。

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

新的大语言模型框架和基准推动自动短答案评分发展

本文如何被排名

Signal score
12 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Research
两篇发表在arXiv上的研究论文，介绍了自动短答案评分的新方法和基准。
Source corroboration
2 independent sources
Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics
paper, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

完整方法见我们的编辑标准。

报道来源 [2]

  1. arXiv cs.CL TIER_1 English(EN) · Zhifan Sun, Sebastian Gombert, Fabian Zehner, Leon Camus, Longwei Cong, Hendrik Drachsler ·

    Rubric Spans are Label Representations: Joint LLM Encoding for Short Answer Scoring

    arXiv:2610.09660v1 Announce Type: new Abstract: Automatic Short Answer Scoring (ASAS) requires models that can score student responses against question-specific criteria while remaining efficient and transferable across rubric sets. We propose RUSPAN, a rubric-conditioned ASAS fr…

  2. arXiv cs.CL TIER_1 English(EN) · Zhifan Sun, Sebastian Gombert, Jannik Lossjew, Tobias Wyrwich, Berrit Katharina Czinczel, David Bednorz, Marcus Kubsch, Knut Neumann, Hendrik Drachsler ·

    Alice：一个用于基于评分标准的、多维度的、自动短答案评分的大型德语基准测试

    arXiv:2610.09661v1 Announce Type: new Abstract: Automatic Short Answer Scoring (ASAS) is central to NLP for Education. However, openly available benchmarks remain scarce, and existing datasets largely address how well students answer a question directly rather than how well they …

相关实体

相关话题