ruler
PulseAugur coverage of ruler — every cluster mentioning ruler across labs, papers, and developer communities, ranked by signal.
6 day(s) with sentiment data
-
New Self-Indexing Attention boosts LLM long-context inference speed
Researchers have developed a new framework called Self-Indexing Attention designed to improve the efficiency of sparse long-context Large Language Model (LLM) inference. This training-free method utilizes a shared trans…
-
KV Cache Compression Research Identifies Temporal Aggregation as Key Factor
Researchers have investigated the impact of temporal aggregation and ranking preservation on decoding-time KV cache compression in large language models. They found that exponential moving average (EMA) aggregation can …
-
New Faster Flash Decoding framework boosts LLM long-context efficiency
Researchers have developed Faster Flash Decoding (FFD), a new framework that significantly improves the efficiency of long-context decoding in Large Language Models. FFD addresses the memory bandwidth bottleneck and qua…
-
New EXACT method boosts long-context adaptation in Qwen and LLaMA models
Researchers have introduced EXACT, a novel supervision-allocation objective designed to improve long-context adaptation in language models. This method addresses a mismatch where packed training with document masking re…
-
Tail-Replay boosts hybrid LLM inference speed by enabling unconstrained prefix reuse
Researchers have introduced Tail-Replay, a novel prefix caching mechanism designed to enhance the efficiency of hybrid large language models. These models combine full-attention and linear-attention layers to manage lon…
-
A.X K2 language model debuts with 688B parameters and agentic focus
A new technical report introduces A.X K2, a 688 billion parameter Mixture-of-Experts (MoE) language model designed for agentic applications. Despite being trained on fewer tokens than its predecessor, A.X K1, A.X K2 dem…
-
CRISP method boosts LLM inference speed and accuracy for long contexts
Researchers have developed CRISP, a novel method to improve the efficiency of long-context Large Language Model (LLM) inference. CRISP addresses the quadratic scaling bottleneck of self-attention during the prefilling p…
-
PolicyLong advances LLM context extension with on-policy data evolution
Researchers have introduced PolicyLong, a novel method for extending the context windows of large language models by dynamically constructing training data. Unlike previous offline methods that use a fixed model to gene…
-
PragAlign system improves multilingual reply assistance, outperforming baselines in Chinese
Researchers have developed PragAlign, a new system designed to improve reply assistance across different languages and cultures. PragAlign separates context reading from selective clarification, and was evaluated agains…
-
New KV cache compression techniques aim to boost LLM long-context performance
Researchers are developing new methods to compress the key-value (KV) cache in large language models, a major bottleneck for long-context inference. Minima-KV uses a mixed-format approach, storing recent pages in FP8 an…
-
Pokee AI launches 28B model with 10M-token context for on-premise use
Pokee AI has released Pokee-Isaac 28B, a 28 billion parameter text-only foundation model designed for deployment within private customer boundaries. This model boasts a 10 million token context window, enabling it to ma…
-
New benchmarks test LLM long-context reasoning beyond simple retrieval
New benchmarks are emerging to test the capabilities of large language models (LLMs) in handling extended contexts, moving beyond simple "needle in a haystack" retrieval tests. While the needle test, popularized by Greg…
-
New research explores LLM efficiency and reasoning improvements
Several research papers explore methods to enhance the efficiency and reliability of large language models (LLMs). Hugging Face's LFM2.5-DSpark demonstrates up to 3.2x faster inference speeds by using speculative decodi…
-
AMD releases open Instella-MoE-16B LLM with 2.8B active parameters
AMD has released Instella-MoE-16B-A3B, an open-source Mixture-of-Experts language model. This model features 16 billion total parameters but only activates 2.8 billion per token, utilizing architectural innovations like…
-
New framework enables LLMs to generate complex multi-view visualizations
Researchers have developed Crystalis, a new framework designed to enable large language models (LLMs) to generate coordinated multi-view visualizations (CMVs). Current LLMs struggle with the complex interdependencies in…
-
PIVOT indexing method accelerates sparse attention in LLMs
Researchers have developed PIVOT, a novel indexing method designed to optimize token-level sparse attention in large language models. PIVOT addresses the bottleneck created by indexers in systems like DeepSeek Sparse At…
-
New LOCKS method drastically cuts LLM long-context decoding latency
Researchers have developed a new method called LOCKS (Page-Local Compact Key Summaries) to improve the efficiency of long-context decoding in large language models. This technique addresses the bottleneck caused by the …
-
OpenAI subreddit user seeks chat evaluation benchmarks
A user on the r/OpenAI subreddit is seeking recommendations for datasets and benchmarks to evaluate chat model performance. They are specifically interested in measuring multi-turn accuracy and memory management, noting…
-
Pulsar Attention offers efficient LLM inference for long sequences
Researchers have introduced Pulsar Attention, a novel method designed to improve the efficiency of inference with large language models on long sequences. Unlike previous blockwise methods like Star Attention that use a…
-
New algorithm learns constant-depth circuits under locally sampleable graphical models
Researchers have developed a new algorithm for learning constant-depth circuits under graphical models that can be locally sampled. This work extends previous findings by Chandrasekaran, Gaitonde, Moitra, and Vasilyan (…