COMPINT

LLMs silently drop user instructions during context compaction, new study finds

Researchers have identified a critical issue where Large Language Models (LLMs) drop important user instructions, termed Session Constraints (SCs), when compacting context to manage long contexts. An evaluation suite ca…