研究人员推出SURE，一个旨在标准化和提高语音理解模型评估可复现性的统一框架。该框架通过标准化预测格式、归一化和评分方法，解决了比较不同语音基础模型和语音大语言模型（Speech LLMs）的挑战。SURE还包括一个将研究论文和代码转换为可运行训练管道的系统，旨在提高面向部署的语音AI结果的可比性和可复现性。 AI
影响 标准化语音AI模型的评估并提高其可复现性，有助于部署决策。
排序理由 该集群描述了一篇关于语音理解模型实验框架的新研究论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2606.01016v1 Announce Type: cross Abstract: While End-to-End (E2E) Speech-Large Language Models (Speech-LLMs) are rapidly evolving, their evaluation methodologies remain limited to the era of simple transcription. Existing benchmarks suffer from three critical limitations: …
arXiv:2605.30899v1 Announce Type: cross Abstract: Speech foundation models and Speech LLMs have advanced speech understanding, yet deployment-oriented model selection is hindered by non-comparable evaluations caused by mismatched post-processing, and by training results that are …
Speech foundation models and Speech LLMs have advanced speech understanding, yet deployment-oriented model selection is hindered by non-comparable evaluations caused by mismatched post-processing, and by training results that are hard to reproduce across data scales and pipelines…