RWKV-7
PulseAugur coverage of RWKV-7 — every cluster mentioning RWKV-7 across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New HART model combines attention and RWKV for improved time series forecasting
Researchers have developed HART, a novel time series foundation model that combines attention and RWKV blocks to improve long-horizon forecasting. The model addresses the degradation observed in pure RWKV models when pr…
-
New research proposes exact record omission for LLMs via checkpoint replay
A new research paper introduces a method for achieving exact record omission in large language models, a crucial aspect for privacy and data management. The study proposes a 'transport criterion' and a 'replay certifica…
-
Developer releases RWKV-7 adapter with KANs for faithful prose rewriting
A developer has created an open-source adapter for the RWKV-7 language model, named RWKV-7 KAN Humanizer v7.2, which aims to improve prose readability without altering factual content. This adapter utilizes Kolmogorov-A…
-
New SANE technique stabilizes extreme-context recurrent models
Researchers have developed a new technique called State Anomaly Neutralization (SANE) to improve the stability of Delta-Rule recurrent models when processing extremely long contexts. These models, which typically have $…
-
WriteSAE enables direct manipulation of recurrent language model states
Researchers have developed WriteSAE, a novel sparse autoencoder designed to manipulate the matrix updates within recurrent language model states. This method learns rank-1 matrix atoms that directly replace the model's …
-
New method speeds up triangular inversion for linear transformers
Researchers have developed a new method for triangular inversion, a crucial operation in linear attention mechanisms used by advanced models like Qwen3.5/3.6 and Kimi Linear. This technique significantly improves the sp…