研究人员开发了新方法来提高语音处理模型的效率和性能。FastSLM引入了分层时间抽象器，可在保留关键声学细节的同时显著压缩音频数据，以更少的资源超越了最先进的模型。SALSA提供了一种轻量级的语音感知大型语言模型的适应技术，通过学习特定的引导向量来增强其对多样化和域外语音的泛化能力。此外，一种新颖的训练优化方法允许对语音模型的性能和计算复杂度进行联合调整，从而无需事后剪枝即可实现动态尺寸优化。 AI
影响 这些进展旨在提高语音模型的效率和适应性，有望在音频处理和语言理解领域实现更强大、更多功能的AI应用。
排序理由 该集群包含多篇详细介绍语音处理和适应技术新研究的学术论文。
在 Hugging Face Daily Papers 阅读 →
AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →
arXiv:2601.06199v3 Announce Type: replace-cross Abstract: Scaling Multimodal Large Language Models (MLLMs) to long-form speech is bottlenecked by the explosive growth of input tokens. Unlike images or videos, audio lacks overlapping information, making extreme 1-token compression…
arXiv:2606.00460v1 Announce Type: new Abstract: Speech-aware large language models often generalize poorly to out-of-domain settings. We propose SALSA (Speech-Aware LLM Adaptation via Learned Steering Activations), a lightweight adaptation method that learns layer-wise steering v…
arXiv:2601.13704v3 Announce Type: replace-cross Abstract: In speech machine learning, neural network models are typically designed by choosing an architecture with fixed layer sizes and structure. These models are then trained to maximize performance on metrics aligned with the t…
Swanbench-Speech addresses the lack of comprehensive long-form speech evaluation by providing a benchmark with diverse scenarios, multi-dimensional metrics, and insights into model limitations.