ruler
PulseAugur coverage of ruler — every cluster mentioning ruler across labs, papers, and developer communities, ranked by signal.
- instance of LongBench-v2 90%
- used by BABILong 90%
- instance of BABILong 90%
- used by LongBench: a bilingual, multitask benchmark for long context understanding 70%
- used by LongBench-v2 70%
- used by Gated DeltaNet 70%
- developed LongBench: a bilingual, multitask benchmark for long context understanding 70%
- used by Gotit.pub 50%
11 day(s) with sentiment data
-
EarlySelectKV optimizes long-context LLM inference, boosting speed and cutting memory use
Researchers have developed EarlySelectKV, a novel method for optimizing long-context inference in large language models. This technique uses proxy queries from earlier hidden states to precompute selected KV indices, al…
-
SparseGDN framework enhances linear attention efficiency for long contexts
Researchers have developed SparseGDN, a new framework designed to improve the efficiency of linear attention mechanisms in sequence modeling. This approach addresses the computational costs associated with long-context …
-
New DAMI technique boosts long-context retrieval in linear attention models
Researchers have introduced Dual-Axis Memory Initialization (DAMI), a novel technique to improve long-context retrieval in linear attention models. DAMI focuses on optimizing the initialization of gate parameters that c…
-
MERLIN enhances LLM long-context understanding with moment-based routing
Researchers have introduced MERLIN (MomEnt Routing for multi-state LINear attention), a novel method designed to enhance the efficiency and performance of large-language models in handling long sequences. MERLIN improve…
-
Elon Musk's AI-generated 'Odyssey' episode draws criticism for poor quality
Elon Musk has released a seven-minute AI-generated episode of "The Odyssey," created using Grok AI, as a response to Christopher Nolan's film. The AI-generated content is criticized for its dullness, poor graphics resem…
-
Mirendil launches Fern 0.1 with 10M-token context window
Mirendil has released Fern 0.1, its inaugural AI model, featuring an extensive 10 million token context window. This model is designed for AI research and development tasks, particularly for processing large codebases a…
-
Language models can learn during inference, research finds
A new research paper explores the concept of language models learning during inference, a process termed dynamic evaluation. The study found that standard softmax-attention models, when allowed to perform gradient steps…
-
New active recap learning framework boosts LLM long-context understanding
Researchers have introduced active recap learning (ARL), a novel framework designed to significantly enhance the long-context understanding capabilities of large language models (LLMs). This method involves a two-stage …
-
MoEZip: New KV Cache Compression for Sparse MoE LLMs
Researchers have developed MoEZip, a novel KV cache compression technique specifically designed for sparse Mixture-of-Experts (MoE) language models. Unlike existing methods that can degrade MoE performance by altering e…
-
New Test-Time Regression Method Enhances Sequence Compression in AI Models
Researchers have introduced TTR-Compressor, a novel method for sequence compression in language and multimodal models. This approach frames compression as a test-time regression problem, where input tokens define a regr…
-
Stratified Sparse Attention boosts LLM long-context inference speed and accuracy
Researchers have developed Stratified Sparse Attention (SSA), a new framework designed to improve the efficiency and accuracy of large language model inference over long contexts. SSA combines deterministic retrieval of…
-
NoteBank enhances long-context recall in linear-attention models
Researchers have developed a novel technique called NoteBank to enhance long-context recall in language models that use linear attention or state-space architectures. This method acts as a training-free add-on, storing …
-
AdCoEvo system automates advertising delivery with co-evolving agents · 2 sources tracked
Researchers have introduced AdCoEvo, a novel co-evolving multi-agent system designed to automate the entire advertising delivery process. This system aims to overcome the limitations of current methods, which often requ…
-
Latent Compaction technique compresses LLM KV caches using test-time training
Researchers have developed a new technique called Latent Compaction, which uses test-time training to compress key-value (KV) caches in large language models. This method learns a document-specific compact cache by opti…
-
Prefilling-dLLM v2 boosts long-context diffusion models with learned routing
Researchers have developed Prefilling-dLLM v2, a method to improve the efficiency of diffusion language models for long contexts. This approach involves continued training of the model to route information across chunks…
-
Attic-KV method improves LLM KV cache efficiency through self-quizzing
Researchers have developed a new method called Attic-KV that improves the efficiency of key-value (KV) caches in large language models. Unlike traditional methods that involve rereading the entire context, Attic-KV uses…
-
Complex KDA enables rotations in linear attention for advanced state tracking
Researchers have detailed a new type of linear attention mechanism called Complex KDA (CKDA), which allows for rotations in memory updates, enabling more sophisticated state tracking than previous linear models. This me…
-
AI agents to use machine-readable constitutions for governance
A new approach to AI agent governance proposes treating project rules as code, with memory acting as an auditable ledger. This system, managed by an MCP server, uses Merkle hashes to ensure rule integrity and prevent si…
-
New LCLM Architecture Compresses LLM Context 16x, Boosting Efficiency
Researchers have developed Latent Context Language Models (LCLMs) that compress input text by a factor of 16 before it reaches the decoder, significantly reducing memory and computational costs. This novel approach, dev…
-
Hybrid Linear Attention improves long-context LLM performance
Researchers have developed Hybrid Linear Attention (HLA), a novel attention mechanism designed to improve long-context modeling in large language models. HLA dynamically routes information based on the query, allowing f…