LLMs' judgment of answer factuality influenced by reasoning chains

A new research paper explores how large language models (LLMs) judge the factuality of answers, particularly when presented with reasoning chains. The study found that while some LLMs can leverage reasoning as evidence, they are often misled by fluent but incorrect reasoning. The research highlights that both the fluency and factuality of reasoning chains significantly influence LLM judgments, indicating a need for more robust LLM judges capable of discerning true reasoning quality. AI

IMPACT Highlights the need for more robust LLM judges capable of discerning genuine reasoning quality from superficial fluency.

RANK_REASON Research paper published on arXiv detailing findings about LLM behavior. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

• alphaXiv
• arXiv
• CatalyzeX Code Finder for Papers
• CORE Recommender
• DagsHub
• Gotit.pub
• Hugging Face
• Influence Flower
• LLMs
• ScienceCast
• Shiyu Ni

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →