English(EN) Polyphony: Diffusion-based Dual-Hand Action Segmentation with Alternating Vision Transformer and Semantic Conditioning

Polyphony 方法改进双臂动作分割

作者 PulseAugur 编辑部 · [2 个来源] · 2026-05-29 10:26

研究人员推出了一种新颖的三阶段双臂动作分割方法 Polyphony。该方法利用交替双臂视觉 Transformer 来平衡双手梯度贡献，并采用语义特征条件化来提高相似动作的区分度。Polyphony 还结合了基于扩散的分割和跨臂特征融合，以增强协调性，并在多个数据集上取得了最先进的成果。 AI

影响增强对复杂双臂活动的理解，可能改进机器人技术和人机交互。

排序理由该集群包含一篇详细介绍新动作分割方法的论文。

AI 生成摘要 · Google Gemini · 来自 2 个来源。我们如何撰写摘要 →

报道来源 [2]

arXiv cs.CV TIER_1 English(EN) · Hao Zheng, Hu Wang, Tiantian Zheng, Prajjwal Bhattarai, Tuka Alhanai · 2026-06-01 04:00

Polyphony：基于扩散模型的双臂动作分割，结合交替视觉Transformer和语义条件

arXiv:2605.31115v1 Announce Type: new Abstract: Dual-hand action segmentation, densely predicting actions for both hands from untrimmed videos, is essential for understanding complex bimanual activities. However, it poses several unique challenges: complex inter-hand dependencies…
arXiv cs.CV TIER_1 English(EN) · Tuka Alhanai · 2026-05-29 10:26

Polyphony：基于扩散模型的双臂动作分割，采用交替视觉Transformer和语义条件

Dual-hand action segmentation, densely predicting actions for both hands from untrimmed videos, is essential for understanding complex bimanual activities. However, it poses several unique challenges: complex inter-hand dependencies, visual asymmetry between hands, representation…