LLMs exhibit 'anchored confabulation,' amplifying confident hallucinations with partial evidence

Researchers have identified a new phenomenon in large language models called "anchored confabulation," where providing partial evidence can paradoxically increase the model's tendency to confidently hallucinate. This effect, formalized as Parametric Hallucination Confidence (PHC), was observed across multiple model families and predicted by a new law, the Anchoring Threshold Law. The findings suggest implications for retrieval-augmented generation (RAG) systems, with a proposed LearnedRouter demonstrating significant performance gains by exploiting PHC. AI

IMPACT Identifies a new LLM failure mode that can be exploited to improve RAG systems and reduce hallucinations.

RANK_REASON Academic paper detailing a novel LLM behavior and its implications.

Read on arXiv cs.CL →

• Anchoring Threshold Law
• arXiv
• Ashish Balkishan Lathkar
• Hugging Face
• LearnedRouter
• Parametric Hallucination Confidence

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →