Xinyu Gao

New Gated Tree Cross-Attention enhances LLM syntax robustness without compromising performance

Researchers have developed a novel method called Gated Tree Cross-Attention (GTCA) to improve the grammatical robustness of decoder-only large language models. This approach injects explicit syntactic structure into exi…