Self-Consistency In Llms
PulseAugur coverage of Self-Consistency In Llms — every cluster mentioning Self-Consistency In Llms across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
AI adviser panels: more advisers mean more visible dissent, study finds
A new paper explores the implications of Condorcet's jury theorem when applied to multiple AI advisers. The research highlights a "latent dimension" where increasing the number of AI advisers, while improving reliabilit…
-
Research: Larger models outperform increased inference compute for text-to-SQL
A new research paper explores the trade-offs between model size and inference compute for grammar-constrained text-to-SQL tasks. The study found that increasing model size generally yields better accuracy than increasin…
-
Power Sampling Paradox: Reasoning Technique Degrades LLM Answers
Researchers have identified a paradox with Power Sampling, a technique used to improve language model reasoning. While it can concentrate probability mass towards correct answers, it paradoxically leads to worse overall…
-
LLM research suggests input diversity boosts accuracy more than output diversity
A new research paper explores Test-Time Augmentation (TTA) for Large Language Models (LLMs), proposing that diversifying input data is more compute-efficient for accuracy gains than diversifying output reasoning paths. …
-
GradCuit enhances LLM reasoning at test time without weight changes
Researchers have developed GradCuit, a novel method to enhance LLM reasoning at test time without altering model weights. This technique involves inserting optimizable latent vectors into an intermediate Transformer lay…
-
New CALM framework trains LLMs to adapt to diverse inference controllers
Researchers have developed CALM, a post-training framework designed to improve the adaptability of large language models (LLMs) to various inference-time controllers. Unlike previous methods that optimize for a single i…
-
New framework GRAPHEVAL quantifies LLM reasoning uncertainty and coherence
Researchers have developed GRAPHEVAL, a novel graph-based framework to assess the reasoning capabilities of Large Language Models (LLMs). This framework introduces the Graph Reasoning Coherence Score (GRCS) to quantify …
-
Generative models simulate attitude change theories
Researchers have developed a new workflow for creating executable simulations of attitude change theories using generative models. This approach renders theories like cognitive dissonance, self-consistency, and self-per…
-
New SEVRA method optimizes LLM reasoning for better accuracy and efficiency
Researchers have developed a new method called Selective Verification for Reasoning Allocation (SEVRA) to optimize the use of reasoning in large language models. SEVRA acts as a serving-layer controller, deciding whethe…
-
New CGES method cuts LLM calls by 58% while maintaining accuracy
Researchers have developed a new Bayesian framework called Confidence-Guided Early Stopping (CGES) to improve the efficiency of large language model (LLM) querying. CGES adaptively halts sampling once a single answer ga…
-
Self-consistency technique shows diminishing returns for modern LLMs
A new study suggests that the self-consistency technique, which involves generating multiple reasoning paths to improve LLM accuracy, is becoming less effective and more costly. Researchers found minimal accuracy gains …
-
LLMs tackle model collapse, bias, and inference costs with new techniques
A new version of the open-source LLM toolkit, LLM 0.32a1, has been released, fixing a bug in tool-calling conversations stored in SQLite and improving AI agent reliability. Separately, research on adaptive thinking in L…
-
Process Supervision via Verbal Critique Improves Reasoning in Large Language Models
Researchers have developed a new framework called Verbal Process Supervision (VPS) that enhances the reasoning capabilities of large language models without requiring gradient updates. This method utilizes structured na…