English(EN) Connecting Speech to Words through Images

新方法在无文本监督的情况下将口语与图像关联起来

作者 PulseAugur 编辑部 · [2 个来源] · 2026-06-15 14:50

研究人员开发了一种新颖的方法，可以在不依赖显式文本监督的情况下创建口语词汇。该方法使用图像及其语音描述来构建书面词汇表，然后将它们与相关的音频片段对齐。该系统利用无监督词发现技术将口语片段与其书面对应词联系起来，在口语检索和关键词识别任务中表现出有效性。 AI

影响支持低资源语言开发，并提高语音转文本系统的可解释性。

排序理由该集群包含一篇在 arXiv 上发表的学术论文，详细介绍了一种新的研究方法。

AI 生成摘要 · Google Gemini · 来自 2 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Research; 该集群包含一篇在 arXiv 上发表的学术论文，详细介绍了一种新的研究方法。
Source corroboration: 2 independent sources; Multiple independent publishers reporting the same story raises confidence that it's real and newsworthy.
Topics: paper, other; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 73 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

arXiv cs.CL TIER_1 English(EN) · Gabriel Pirlogeanu, Dan Oneata, Horia Cucu, Herman Kamper · 2026-06-16 04:00

图像连接语音与文字

arXiv:2606.16807v1 Announce Type: new Abstract: How can we learn the mapping between written words and their spoken counterparts in the absence of explicit textual supervision? We present a visually grounded method for building a vocabulary of spoken words using only images and t…
arXiv cs.CL TIER_1 English(EN) · Herman Kamper · 2026-06-15 14:50

图像连接语音与文字

How can we learn the mapping between written words and their spoken counterparts in the absence of explicit textual supervision? We present a visually grounded method for building a vocabulary of spoken words using only images and their spoken descriptions. First, image captionin…