English(EN) Joint Training Is Not Enough: Conditioned Cross-Granularity Training for Multimodal Document Understanding

条件化训练提升多模态文档理解能力

作者 PulseAugur 编辑部 · [1 个来源] · 2026-09-01 05:39

研究人员探索了多模态文档理解中的互补增强效应（MRE），特别是同时在细粒度（跨度级别）和粗粒度（文档级别）任务上训练单个模型是否能同时提升性能。他们发现在三个语料库（收据和商业表格）上，标准的联合训练并未在两个粒度上持续增强性能。然而，一种“条件化训练”方法，在训练过程中将一个任务的黄金标准输出馈入另一个任务的提示中，在三个数据集中的两个上显示出显著的改进，尤其是在文档级别任务上。 AI

影响引入了一种新颖的训练技术，可能会提高复杂文档理解任务的性能。

排序理由详细介绍多模态文档理解新颖训练方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。我们如何撰写摘要 →

本文如何被排名

Signal score: 0 / 100; Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket: Tool; 详细介绍多模态文档理解新颖训练方法的学术论文。[lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration: Single-source cluster; Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics: paper, model release; Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance: High; Clearly on-topic for AI-industry coverage.
Story freshness: 45 days old; Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

完整方法见我们的编辑标准。

报道来源 [1]

Hugging Face Daily Papers TIER_1 English(EN) · 2026-09-01 05:39

联合训练尚有不足：面向多模态文档理解的条件化跨粒度训练

The Mutual Reinforcement Effect (MRE) asks whether a fine, span-level and a coarse, document-level task help each other when one model handles both. We test it in multimodal document understanding on three corpora, two of receipts and one of scanned business forms, comparing sing…

本文如何被排名

报道来源 [1]

联合训练尚有不足：面向多模态文档理解的条件化跨粒度训练

相关话题