Misra et al.

Visual grounding boosts small language models on specific knowledge tasks

A new research paper explores the impact of visual grounding on small language models, specifically DeBERTa. By initializing tokens with embeddings derived from labeled image regions, the study found that this visual se…