Natural Questions
PulseAugur coverage of Natural Questions — every cluster mentioning Natural Questions across labs, papers, and developer communities, ranked by signal.
6 day(s) with sentiment data
-
New OECP framework enhances NLP evidence verification
Researchers have introduced a new framework called Online Evidence-Containment Prediction (OECP) for natural language processing systems. OECP addresses the sequential verification of text regions, where confirming one …
-
New RAG evaluation framework exposes hidden defense failures · arXiv paper
A new research paper published on arXiv introduces "Aligned RAG Evaluation," a novel framework designed to more accurately assess the effectiveness of defenses against knowledge poisoning in retrieval-augmented generati…
-
New research evaluates factuality in agentic RAG systems
A new arXiv paper explores conformal factuality in agentic retrieval-augmented generation (RAG) systems. The research evaluates how well models like GPT-6 Luna and Llama-3.1 8B adhere to factual grounding when using ada…
-
Agentic RAG models evaluated for factual accuracy across datasets
A new paper explores conformal factuality in agentic retrieval-augmented generation (RAG) systems, where models adaptively issue follow-up retrieval queries. The study evaluated six configurations using GPT-6 Luna and L…
-
New Decision Model Approach Enhances Document Navigation Beyond Traditional Retrieval
Researchers have developed DecisionRAG, a novel approach to document navigation that bypasses traditional retrieval methods. Instead of relying on lexical matching or fixed embedding spaces, DecisionRAG employs decision…
-
New GRaSP system optimizes geo-distributed RAG latency and cost
Researchers have developed GRaSP, a novel re-scoring layer for retrieval-augmented generation (RAG) systems designed to optimize performance in geo-distributed infrastructures. This system addresses challenges like wide…
-
RAGFlip paper measures negative flips in retriever upgrades
A new research paper, RAGFlip, introduces a method for evaluating retriever upgrades by focusing on query-level negative flips. These flips occur when a new retriever fails to find a relevant passage that a previous ret…
-
Conformal factuality control enhances multi-hop RAG, but reduces output.
Researchers have explored the effectiveness of conformal factuality control in multi-hop retrieval-augmented generation (RAG) systems. Their study, applied to datasets like HotpotQA, Natural Questions, and TriviaQA usin…
-
New ReDSI framework improves DSI reproducibility for document retrieval
Researchers have introduced ReDSI, an open-source implementation of the differentiable search index (DSI) framework, designed to address issues of reproducibility and evaluation consistency in generative retrieval. The …
-
New TRIS defense system combats knowledge poisoning in RAG models
Researchers have developed TRIS, a Tri-Layer Retrieval Integrity Sieve, to combat knowledge poisoning in retrieval-augmented generation (RAG) systems. This middleware defense system sanitizes retrieved evidence by emplo…
-
New PruneShift framework evaluates AI model pruning decision reliability
Researchers have introduced PruneShift, a new framework designed to evaluate the reliability of decisions made during structured pruning in machine learning models. Unlike previous methods that focused on average surrog…
-
New research probes RAG reliability, utility, and hallucination risks · 8 sources tracked
Recent research explores the nuances of Retrieval-Augmented Generation (RAG) systems, focusing on improving their reliability and utility. One paper details a system for the LLMs4OL 2026 Challenge that uses retrieval-au…
-
New audit method reveals hidden answer churn in retrieval-augmented QA systems
A new research paper introduces the Snapshot Compatibility Audit, a method to detect "accuracy-blind answer churn" in retrieval-augmented QA systems. This phenomenon occurs when system updates, such as index expansion, …
-
New benchmark reveals RAG models struggle with misleading context
A new study published on arXiv introduces GRAB-RAG, a benchmark designed to evaluate retrieval-augmented generation (RAG) models' ability to distinguish between missing and misleading context. The research found that ev…
-
Edge RAG systems can save energy with adaptive compression, study finds
A new research paper explores adaptive compression techniques for retrieval-augmented generation (RAG) systems operating on edge devices. The study, conducted on an NVIDIA Jetson AGX Thor, demonstrates that dynamically …
-
New research explores static pruning and LLM-based query expansion for retrieval systems
Two new research papers explore methods to improve information retrieval systems. The first paper, "Static Pruning Across Sparse Retrieval Regimes," investigates how static pruning techniques can be applied across diffe…
-
SAGE system optimizes RAG retrieval for latency and cost · 2 sources tracked
Researchers have developed SAGE, a new adaptive retrieval policy for production Retrieval-Augmented Generation (RAG) systems. SAGE dynamically adjusts the number of passages retrieved per query based on estimated query …
-
TAPR refines LLM prompts to boost benchmark accuracy
TAPR, a new system, automatically refines user prompts for large language models using reinforcement learning. This process enhances the accuracy of LLM responses, particularly on benchmarks like Natural Questions and GSM8K.
-
New RAG defense frameworks combat data poisoning attacks · 3 sources tracked
Researchers have developed new defense frameworks to protect Retrieval-Augmented Generation (RAG) systems from data poisoning attacks. RAGuard, presented in two papers, employs a layered approach including adversarial r…
-
SmartRAG enables LLMs on mobile devices with graph-based RAG
Researchers have developed SmartRAG, a novel on-device framework designed to enable large language models (LLMs) to function as personal assistants on mobile devices. This system decomposes intelligence into four module…