Cooperative Memory Paging with Keyword Bookmarks for Long-Horizon LLM Conversations
A new research paper introduces cooperative memory paging, a technique designed to help Large Language Models (LLMs) manage conversations that exceed their context window. This method replaces evicted conversation segments with concise keyword bookmarks, allowing the LLM to retrieve full content using a recall tool when necessary. Experiments on the LoCoMo benchmark demonstrated that cooperative paging outperformed other methods in answer quality across multiple LLMs, though the effectiveness was significantly impacted by the distinctiveness of the generated bookmarks. AI
IMPACT Improves LLM ability to recall information from extended conversations, potentially enhancing user experience and task completion.