New benchmark and synthesis pipeline enhance chart referring expression grounding

Researchers have introduced ChartREG++, a new benchmark designed to improve the grounding of referring expressions in charts. This benchmark addresses limitations in existing datasets by supporting multiple localization forms, handling multi-instance references, incorporating diverse grounding cues, and covering a wider range of chart types. The team also developed a code-driven synthesis pipeline to generate pixel-accurate instance masks for training an instance segmentation model, which, when integrated into a multimodal grounding framework, demonstrated superior performance on their benchmark and generalized to real-world chart grounding tasks. AI

影响 Enhances multimodal models' ability to interpret and ground information within complex chart visualizations.

排序理由 The cluster contains a research paper introducing a new benchmark and methodology for a specific AI task. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CL 阅读 →

• ChartREG++
• Tianhao Niu

• 论文
• 产品

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →