English(EN)A Reverse Sign Language Dictionary: Open-Vocabulary Sign Recognition from Continuous Signing via Video Captioning and Description Retrieval
新AI模型在手语识别和生成方面取得进展
作者PulseAugur 编辑部·[5 个来源]·
研究人员开发了超越传统闭集分类的新型手语识别和生成方法。一种方法利用视频字幕和描述检索来创建一个能够处理开放词汇和连续手语的反向手语词典，在识别已见和未见手语方面均有显著改进。另一种方法SignSeek通过对比学习手语并使用发音部位显著性引导掩码来学习手语词典检索的可迁移表示，在多种手语上取得了最先进的性能，甚至无需微调即可泛化到未见过的手语。SignMatch也通过学习原型结构嵌入空间来匹配词典手语与连续视频，展示了有效的跨语言泛化能力。最后，SignRR通过结合真实运动片段检索和学习到的精炼来确保全局连贯性，从而解决手语生成问题，在反向翻译和姿态质量方面优于先前的方法。
AI
arXiv:2609.03788v1 Announce Type: cross Abstract: Isolated Sign Language Recognition (ISLR) is conventionally cast as closed-set classification over gloss labels, which cannot generalize to signs unseen in training and ties every deployment to a gloss-annotated lexicon. We instea…
Isolated Sign Language Recognition (ISLR) is conventionally cast as closed-set classification over gloss labels, which cannot generalize to signs unseen in training and ties every deployment to a gloss-annotated lexicon. We instead recognize signs extracted from continuous signin…
arXiv cs.CV
TIER_1English(EN)·Sobhan Asasi, Ozge Mercanoglu Sincan, Richard Bowden·
arXiv:2609.03695v1 Announce Type: new Abstract: Sign language dictionaries are essential resources for sign language learners, yet automatically retrieving a sign from a dictionary, given only a query video, remains a challenging problem due to the natural variability between sig…
arXiv:2609.01886v1 Announce Type: new Abstract: The objective of this paper is to match dictionary sign videos to corresponding signs in continuous signing videos, where a match is defined by the visual similarity alone - the handshape and motion relative to the body. To achieve …
arXiv:2608.28568v1 Announce Type: new Abstract: Sign language production (SLP) aims to generate continuous signing motion from spoken language, often through gloss-to-pose generation. Prior work mainly follows two paradigms. Generative models synthesize motion from a learned prio…
