PulseAugur
EN
LIVE 01:51:57

User finds "lost in the middle" absent in current LLMs on simple retrieval tasks

A user attempted to reproduce the "lost in the middle" phenomenon in current large language models, specifically Anthropic's Haiku 4.5 and Sonnet 5. The user found that with up to 30 documents, the models did not exhibit significant position sensitivity in retrieving a single fact. The only observed variation was a change in the format of the answer (e.g., "3" vs. "three"), which the user did not count as a factual flip. The user acknowledges this is a simplified test case and the phenomenon might still occur with longer documents or more complex tasks. AI

IMPACT Suggests current LLMs may be more robust to position bias in retrieval than previously thought for simple tasks.

RANK_REASON User experiment and commentary on LLM behavior, not a primary release or research paper.

Read on r/MachineLearning →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

User finds "lost in the middle" absent in current LLMs on simple retrieval tasks

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Commentary
User experiment and commentary on LLM behavior, not a primary release or research paper.
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, other
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
Same-day
Cluster formed today. Ranking reflects the current source set at time of score.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/MachineLearning TIER_1 English(EN) · /u/Beneficial_Use2116 ·

    I tried to reproduce “lost in the middle” on current models and actually couldn’t do that! [P]

    <!-- SC_OFF --><div class="md"><p>Everyone keeps citing lost in the middle so, instead of going by the paper's citations, i wanted to actually check it on my own stuff, without building a labeled set for it.</p> <p>So i did the lazy version. make up facts the model can’t already …