研究人员正在开发新方法来提高多语言AI模型的效率和能力。一项研究探索了用于多语言语音识别的令牌合并技术,表明该技术可以在不同语言和模型规模下,以极小的准确性影响显著降低计算成本。另一篇论文介绍了CVSS-X,一个大型合成语音到语音翻译语料库,将翻译能力扩展到28种语言。此外,还提出了一个名为DunDun的新指标,用于评估文本到语音系统中的词汇音调,特别是对于像约鲁巴语这样的声调语言,以及一个用于多语言LLM的模块化框架,旨在通过使用特定语言的分词器来提高效率。
AI
arXiv:2609.18516v1 Announce Type: new Abstract: While Large Language Models excel in natural language processing, efficiently extending their capabilities to spoken input remains a significant challenge. Existing methods for building SpeechLLMs often rely on computationally expen…
arXiv:2609.13151v1 Announce Type: new Abstract: Leading multilingual speech recognition models like Whisper transcribe diverse, low-resource languages without language-specific training but are computationally expensive to deploy. Token merging mitigates this inefficiency by dyna…
arXiv cs.CL
TIER_1English(EN)·Lucas Rafael Stefanel Gris, Alef Iury Siqueira Ferreira, Frederico Santos de Oliveira, Augusto Seben da Rosa, Alexandre Costa Ferro Filho, Arlindo Rodrigues Galv\~ao Filho, Anderson da Silva Soares·
arXiv:2609.13413v1 Announce Type: new Abstract: We introduce CVSS-X, a large-scale synthetic speech-to-speech translation corpus that extends CVSS by reversing the translation direction. While CVSS translates from 21 languages into English, CVSS-X enables translation from English…
arXiv:2609.14817v1 Announce Type: new Abstract: In Yor\`ub\'a, pitch alone separates \d{o}k\d{o} (husband, Mid), \d{o}k\d{\`o} (vehicle, Low), and \d{o}k\d{\'o} (hoe, High) -- the diacritics ARE the tone marks. Yet character error rate (CER), the standard automated metric for tex…
arXiv:2609.15528v1 Announce Type: new Abstract: Multilingual Large Language Models (LLMs) traditionally rely on a single vocabulary shared by all supported languages, which can lead to uneven compression across them. Moreover, their large embedding and output matrices increase me…
arXiv cs.LG
TIER_1English(EN)·Tal Kozakov, Tal Rosenwein, Eliya Nachmani·
arXiv:2609.12563v1 Announce Type: new Abstract: Neural audio codecs discretize speech into token sequences, but the resulting token spaces differ in vocabulary and codebook structure, preventing direct communication across models. This limitation affects applications such as conv…