A new arXiv paper explores how large language models, referred to as 'frozen agents,' react when their retrieval tools provide no relevant information. Researchers found that a simple, unannounced refusal signal significantly improved abstention rates on unanswerable questions for models like Qwen3 and Claude Haiku 4.5, drastically reducing incorrect answers. The study also highlighted that the wording of the refusal signal impacts agent behavior, with explanations proving more effective than bare tokens or soft warnings. AI
IMPACT Improved agent abstention rates could lead to more reliable AI systems that better indicate when they lack information.
RANK_REASON The cluster contains a research paper published on arXiv detailing experimental findings on LLM behavior. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
- arXiv
- BM25
- Claude Haiku 4.5
- Claude Sonnet 5.5
- HotpotQA
- Neocorragg
- Opus 5.5
- Qwen3 32B
- Qwen3_8B
- Search-R1
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →