SlimPajama
PulseAugur coverage of SlimPajama — every cluster mentioning SlimPajama across labs, papers, and developer communities, ranked by signal.
-
HOLA enhances linear attention models with a complementary memory system
Researchers have developed a novel approach called HOLA (Hippocampal Linear Attention) to enhance the memory capabilities of linear attention and state-space language models. This method introduces a complementary 'hipp…
-
New HOLA architecture enhances linear attention language models with dual memory system
Researchers have developed HOLA (Hippocampal Linear Attention), a novel architecture that enhances linear attention language models by incorporating a complementary memory system. This system addresses the issue of info…
-
New RAG and Long-Context Models Leverage Knowledge Graphs
Two new research papers introduce advanced methods for improving retrieval-augmented generation (RAG) and long-context language modeling. The first paper, "A Unified Framework for Context-Aware and Relation-Aware Graph …