New research suggests causal evidence outperforms attention for training LLM selectors

A new research paper proposes a method for training sparse attention mechanisms in large language models by using causal evidence sets instead of relying solely on attention patterns. The study found that attention and causal dependence often diverge, leading to performance degradation when attention patterns are used for supervision. By masking parts of the input and observing the impact on the answer, researchers can identify causal evidence, which, when used to train selectors, significantly improves accuracy. For instance, Gemma-2-9B's accuracy rose from 56% to 99% when restricted to relevant sentences, and Qwen2.5-3B showed improved performance when trained on causal evidence rather than attention. AI

IMPACT This research could lead to more efficient and accurate LLMs by improving how sparse attention mechanisms are trained, potentially reducing computational costs and enhancing performance on tasks requiring precise context understanding.

RANK_REASON Research paper detailing a new method for training LLM attention mechanisms. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• Gemma 2 9B
• Qwen2.5-3B

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →