Liu et al. (2023)
PulseAugur coverage of Liu et al. (2023) — every cluster mentioning Liu et al. (2023) across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
LLMs struggle to recall info from middle of long contexts
A study by Liu et al. (2023) titled "Lost in the Middle: How Language Models Use Long Contexts" reveals that Large Language Models do not process information in long contexts uniformly. Instead, they exhibit a U-shaped …
-
LLM context window research shows more is not better for agents
Recent research indicates that increasing the context window size for LLM agents does not necessarily improve performance and can, in fact, degrade it. Studies show that models struggle to effectively utilize vast amoun…
-
AI roleplay characters lose consistency due to context window limits, not memory loss
Large language models in roleplaying applications often lose character consistency and plot details after a limited number of conversational turns, not due to a lack of memory but because the conversation exceeds the mo…
-
LLMs struggle to retrieve info from middle of long context windows
Researchers have identified a significant drop in retrieval accuracy for LLMs when crucial information is placed in the middle of long context windows. This phenomenon, termed "lost in the middle," shows models perform …