Wanyang Hong

New REA framework boosts LLM conversational memory and reduces latency

Researchers have developed REA (Role-aware Heuristic Episodic Attention), a new framework designed to improve how large language models manage context in long conversations. REA addresses issues like attention pollution…