bViT uses single-block recurrence for parameter-efficient vision transformers

Researchers have developed bViT, a novel Vision Transformer architecture that utilizes a single transformer block applied repeatedly for image recognition. This recurrent approach achieves accuracy comparable to standard ViTs on ImageNet-1K with significantly fewer parameters. The study suggests that a substantial portion of a ViT's depth can be achieved through recurrent computation, especially when the representation space is wide, enabling parameter-efficient fine-tuning for downstream tasks. AI

影响 Introduces a parameter-efficient architecture for vision transformers, potentially reducing computational costs for image recognition tasks.

排序理由 The cluster contains an academic paper detailing a new model architecture. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

• bViT
• ImageNet-1K
• Vision Transformers

• 论文
• 模型发布

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →