研究人员推出音频交互模型（AIM），这是一种新颖的大型音频语言模型（LALM），专为实时、交互式音频处理而设计。与之前的离线或单任务流式模型不同，AIM 在连续的感知-决策-响应循环上运行，使其能够动态地理解和响应环境声音和指令。该模型得到了 SoundFlow 框架（用于端到端开发）、名为 StreamAudio-2M 的新数据集以及用于评估主动音频干预的基准的支持。 AI
影响 该模型可以通过持续的音频理解实现更自然、更具响应性的人机交互。
排序理由 该集群描述了一篇关于新颖音频处理模型架构和框架的最新研究论文。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2606.05121v1 Announce Type: cross Abstract: Audio is an inherently interactive modality, yet today's Large Audio Language Models (LALMs) are offline, and streaming audio models each handle only a single task such as streaming ASR or voice chatting. It is time to unify them …
Audio is an inherently interactive modality, yet today's Large Audio Language Models (LALMs) are offline, and streaming audio models each handle only a single task such as streaming ASR or voice chatting. It is time to unify them into one online LALM: a model that, through an alw…
A unified streaming audio model is developed that combines offline task execution with real-time audio instruction following through an end-to-end framework supporting multiple audio interaction capabilities.