PulseAugur
实时 18:58:43

新的RBDC协议将视觉模型训练成本降低了30%

研究人员开发了一种名为RBDC的新训练协议,以提高训练大型视觉模型的可资源效率。该方法通过无参数的块对角线方式递归地耦合独立训练的、更窄的模型。在ImageNet上使用Vision Transformers和ResNets进行的评估表明,与现有的增长方法相比,FLOPs减少了30%,准确率相当,并且在相同的训练FLOPs下性能有所提高。RBDC训练的模型在作为对象检测和实例分割等下游任务的骨干网络方面也显示出增强的效用。 AI

影响 降低了训练大型视觉模型的计算成本,可能加速研究和部署。

排序理由 发布了一篇关于视觉模型新颖训练方法学的新学术论文。

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

报道来源 [2]

  1. arXiv cs.CV TIER_1 · Maxim Henry, Adrien Deli\`ege, S\'ebastien Pi\'erard, Marc Van Droogenbroeck ·

    Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models

    arXiv:2605.23656v1 Announce Type: new Abstract: Training high-capacity vision models from scratch requires substantial computational resources. To improve training efficiency of a wide target model, existing growth methods often assume the availability of narrower models, obscuri…

  2. arXiv cs.CV TIER_1 · Marc Van Droogenbroeck ·

    Recursive Block-Diagonal Coupling for Resource-Efficient Training of Vision Models

    Training high-capacity vision models from scratch requires substantial computational resources. To improve training efficiency of a wide target model, existing growth methods often assume the availability of narrower models, obscuring the true computational cost of the entire pip…