HaluEval
PulseAugur coverage of HaluEval — every cluster mentioning HaluEval across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New Fed-SRC method offers private, accurate RAG certification
Researchers have developed Fed-SRC, a novel certification method for federated retrieval-augmented generation (RAG) systems that ensures privacy and accuracy. This system allows clients to share only differentially priv…
-
PrismShine tool released to verify LLM agent answers against evidence
A new tool called PrismShine has been released to address the limitations of existing hallucination checkers in LLM agents. Unlike tools that only evaluate the final output, PrismShine analyzes runtime evidence to ident…
-
New research explores GPU-free and gradient-based LLM hallucination detection
Two new research papers explore methods for detecting hallucinations in large language models (LLMs). The first paper, "How Far Can You Get Without a GPU?", benchmarks lightweight, CPU-feasible methods for hallucination…
-
New SEVA agent tackles LLM hallucination with detailed verification
Researchers have developed SEVA, a novel self-evolving verification agent designed to combat hallucination in LLM-based systems. Unlike traditional verifiers that provide opaque binary labels, SEVA offers detailed evide…
-
Research finds truthfulness is inherited across LLM model families
A new research paper explores the preservation of contextual truthfulness across model lineages, finding that truth scores are strongly maintained from foundational large language models (LLMs) to their downstream varia…
-
New research reveals limits of spectral diagnostics in understanding LLM hallucinations
Researchers have developed a new diagnostic framework to understand how large language models hallucinate by analyzing their self-attention mechanisms. The proposed method, which focuses on the "transport" properties of…
-
New framework uses multiple LLMs to reduce hallucination and bias
Researchers have developed a new framework called Council Mode designed to mitigate hallucinations and biases in Large Language Models. This approach involves querying multiple diverse LLMs simultaneously and then synth…