MS MARCO
PulseAugur coverage of MS MARCO — every cluster mentioning MS MARCO across labs, papers, and developer communities, ranked by signal.
4 day(s) with sentiment data
-
DIY DSSM improves search with translation tables
A developer has created a "poor man's" Deep Structured Semantic Model (DSSM) that uses count-based translation tables to enhance full-text search capabilities. This method enriches the inverted index by associating docu…
-
New Matryoshka Hash Representations improve RAG retrieval efficiency
Researchers have developed Matryoshka Hash Representations (MHR), a novel method for compact semantic retrieval in retrieval-augmented generation (RAG) systems. MHR addresses the challenge of storing large vector indexe…
-
New 'Embedding Surgery' Technique Enhances Dense Retrieval Systems
Researchers have developed a new technique called "embedding surgery" to improve the performance of dense retrieval systems. This method allows for localized, minimal updates to document embeddings at query time, guided…
-
New TRIS defense system combats knowledge poisoning in RAG models
Researchers have developed TRIS, a Tri-Layer Retrieval Integrity Sieve, to combat knowledge poisoning in retrieval-augmented generation (RAG) systems. This middleware defense system sanitizes retrieved evidence by emplo…
-
Supervised fine-tuning impacts LLM instruction sensitivity differently by model scale
A new study published on arXiv investigates how supervised fine-tuning (SFT) affects the instruction sensitivity of large language models. Researchers found that SFT consistently reduces instruction sensitivity in small…
-
New Turkish LLM MoganBert-TR trained with CLM-to-MLM curriculum
Researchers have developed MoganBert-TR, a new Turkish encoder foundation model, and its accompanying embedding model, MoganBert-Embed. Trained from scratch on a filtered Turkish corpus using a novel CLM-to-MLM curricul…
-
New arXiv papers explore privacy, efficiency, and LLM integration in dense retrieval
Four new arXiv papers explore advancements in dense retrieval, a key component for large language models in information retrieval tasks. The first paper introduces a privacy-preserving method using learned deep hashing …
-
Vector database admission control tackles retrieval hubs under workload drift
Researchers have developed a new admission control mechanism for vector databases to mitigate the impact of retrieval hubs, where a single document dominates search results. This system maintains a set of sentinel queri…
-
New research explores static pruning and LLM-based query expansion for retrieval systems
Two new research papers explore methods to improve information retrieval systems. The first paper, "Static Pruning Across Sparse Retrieval Regimes," investigates how static pruning techniques can be applied across diffe…
-
Vector database performance benchmarked across seven systems
A new research paper provides a comprehensive empirical evaluation of seven prominent vector database systems, including FAISS, Qdrant, Milvus, Weaviate, Chroma, pgvector, and LanceDB. The study, which analyzed over 4 m…
-
New study evaluates RAG pipeline for scientific question answering · 2 sources tracked
Researchers have introduced SciRet, a study examining retrieval-augmented generation (RAG) for scientific question answering using the CORD-19 dataset. The study evaluates a fixed RAG pipeline across three different cor…
-
PLAID-PRF enhances dense retrieval with centroid-aware pseudo-relevance feedback
Researchers have introduced PLAID-PRF, a novel method for enhancing multi-vector dense retrieval models like ColBERT. This technique leverages centroid-like tokens within the PLAID framework to perform Pseudo-Relevance …
-
New benchmarks evaluate Portuguese text embedding models, revealing performance gaps
Two new benchmarks, MTEB-PT and MTEB-PT (Brazilian Portuguese), have been released to evaluate text embedding models specifically for the Portuguese language. These benchmarks address the underrepresentation of Portugue…
-
New RAG research enhances LLM retrieval, unlearning, and faithfulness
Multiple research papers are exploring advancements in retrieval-augmented generation (RAG) to improve the performance and efficiency of large language models. Apple's CLaRa framework unifies retrieval and generation in…
-
New method enhances explainability for dense embedding rankers
Researchers have developed a new method called ChunkGroupSHAP to improve the explainability of dense embedding rankers used in information retrieval. This technique clusters semantically related text chunks across docum…
-
GPUSparse system accelerates learned sparse retrieval using GPU parallelization
Researchers have developed GPUSparse, a novel system designed to accelerate learned sparse retrieval models by leveraging GPU parallelization. This system addresses the CPU-bound bottleneck in current sparse retrieval m…
-
TileMaxSim kernel boosts GPU retrieval model speed by 220x
Researchers have developed TileMaxSim, a new IO-aware kernel for GPUs designed to significantly accelerate the MaxSim scoring process used in multi-vector retrieval models like ColBERT. Existing implementations are inef…
-
AI agents fail due to flawed search index distribution, not prompting
A common issue in AI agents is that their search results appear correct but lead to factually wrong answers due to problems with the underlying search index. This is not a prompting issue but a distribution problem, whe…
-
New indexing framework SPI boosts RAG performance in vector databases
Researchers have introduced Semantic Pyramid Indexing (SPI), a novel indexing framework for vector databases designed to enhance retrieval-augmented generation (RAG) pipelines. SPI adapts the retrieval depth based on qu…
-
New research tackles noise and efficiency in full-duplex dialogue systems
Two new research papers explore advancements in full-duplex spoken dialogue systems, which allow for simultaneous listening and speaking. One paper introduces Interference-Resilient Adaptive Fusion (IRAF) to improve rob…