Researchers have developed a new framework called Chain-of-Self-Questioning (CoSQ) to help large language models (LLMs) determine when to abstain from answering questions if their factual support is weak. CoSQ variants, such as Grounded-CoSQ, Critical-CoSQ, and Adaptive-CoSQ, were evaluated across eleven model families on the TruthfulQA benchmark. Grounded-CoSQ demonstrated a significant reduction in incorrect commitments and an increase in answered accuracy, showing that self-assessment can enable tunable decisions for LLMs. AI
IMPACT Enhances LLM reliability by enabling tunable answer-or-abstain decisions, reducing misinformation.
RANK_REASON The cluster describes a new research paper introducing a novel framework for LLMs.
Read on Hugging Face Daily Papers →
- Adaptive-CoSQ
- arXiv
- Chain-of-Self-Questioning
- Critical-CoSQ
- Grounded-CoSQ
- Hugging Face
- Natural Questions Short-Answer
- TruthfulQA
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →