ruler
PulseAugur coverage of ruler — every cluster mentioning ruler across labs, papers, and developer communities, ranked by signal.
7 day(s) with sentiment data
-
Pokee AI launches 28B model with 10M-token context for on-premise use
Pokee AI has released Pokee-Isaac 28B, a 28 billion parameter text-only foundation model designed for deployment within private customer boundaries. This model boasts a 10 million token context window, enabling it to ma…
-
New benchmarks test LLM long-context reasoning beyond simple retrieval
New benchmarks are emerging to test the capabilities of large language models (LLMs) in handling extended contexts, moving beyond simple "needle in a haystack" retrieval tests. While the needle test, popularized by Greg…
-
New LLM inference techniques target efficiency and edge deployment · 7 sources tracked
Multiple research papers introduce novel techniques to enhance Large Language Model (LLM) inference efficiency. Cascade optimizes serving by managing latency budgets for heterogeneous requests, improving goodput and red…
-
AMD releases open Instella-MoE-16B LLM with 2.8B active parameters
AMD has released Instella-MoE-16B-A3B, an open-source Mixture-of-Experts language model. This model features 16 billion total parameters but only activates 2.8 billion per token, utilizing architectural innovations like…
-
New framework enables LLMs to generate complex multi-view visualizations
Researchers have developed Crystalis, a new framework designed to enable large language models (LLMs) to generate coordinated multi-view visualizations (CMVs). Current LLMs struggle with the complex interdependencies in…
-
PIVOT indexing method accelerates sparse attention in LLMs
Researchers have developed PIVOT, a novel indexing method designed to optimize token-level sparse attention in large language models. PIVOT addresses the bottleneck created by indexers in systems like DeepSeek Sparse At…
-
New LOCKS method drastically cuts LLM long-context decoding latency
Researchers have developed a new method called LOCKS (Page-Local Compact Key Summaries) to improve the efficiency of long-context decoding in large language models. This technique addresses the bottleneck caused by the …
-
OpenAI subreddit user seeks chat evaluation benchmarks
A user on the r/OpenAI subreddit is seeking recommendations for datasets and benchmarks to evaluate chat model performance. They are specifically interested in measuring multi-turn accuracy and memory management, noting…
-
Pulsar Attention offers efficient LLM inference for long sequences
Researchers have introduced Pulsar Attention, a novel method designed to improve the efficiency of inference with large language models on long sequences. Unlike previous blockwise methods like Star Attention that use a…
-
New algorithm learns constant-depth circuits under locally sampleable graphical models
Researchers have developed a new algorithm for learning constant-depth circuits under graphical models that can be locally sampled. This work extends previous findings by Chandrasekaran, Gaitonde, Moitra, and Vasilyan (…
-
Jet-Long method boosts LLM long-context performance without retraining
Researchers have introduced Jet-Long, a novel method for extending the context window of large language models without requiring retraining. This tuning-free, zero-shot approach dynamically adjusts rescaling factors to …
-
HOLA enhances linear attention models with a complementary memory system
Researchers have developed a novel approach called HOLA (Hippocampal Linear Attention) to enhance the memory capabilities of linear attention and state-space language models. This method introduces a complementary 'hipp…
-
New HOLA architecture enhances linear attention language models with dual memory system
Researchers have developed HOLA (Hippocampal Linear Attention), a novel architecture that enhances linear attention language models by incorporating a complementary memory system. This system addresses the issue of info…
-
Context Engineering: Optimizing LLM Information Beyond Large Context Windows
Context engineering has emerged as a critical discipline in AI development, focusing on optimizing the information provided to large language models (LLMs) beyond simply increasing context window sizes. This practice in…
-
New RL Framework Optimizes LLM KV Cache for Efficient Inference
Researchers have developed a novel framework called KV Policy (KVP) to address the memory demands of large language models (LLMs) by optimizing the Key-Value (KV) cache. KVP reframes KV cache eviction as a reinforcement…
-
LLM context compaction quality degradation curve observed, lacks benchmarks
A user observed that the output quality of LLMs like DeepSeek V4 and Claude Code does not degrade linearly with repeated context compaction. Instead, there appears to be a temporary improvement after the second compacti…
-
Cursor AI coding tool usage slashed with custom rules and skills
The author details how they significantly reduced their daily usage of AI coding tool Cursor by implementing custom rules and skills. This change was prompted by a realization that their previous approach was inefficien…
-
New framework unifies sequence models using Bayesian memory
Researchers have introduced a "design-model" framework for creating efficient recurrent sequence maps based on memory assumptions. This framework uses Bayesian filtering to write evidence into memory and a query-depende…
-
New metric reveals LLM unlearning methods fail to fully forget sensitive data
A new research paper introduces \"Leak@k\", a metric designed to evaluate the effectiveness of unlearning methods in large language models (LLMs). The study found that most current unlearning techniques fail to complete…
-
New RULER metrics detect residual data in machine unlearning
Researchers have developed RULER, a new set of metrics designed to verify machine unlearning at the representation level. Current methods only check output-level compliance, which can still leave residual information in…