Wanda
PulseAugur coverage of Wanda — every cluster mentioning Wanda across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New PALS pruning method shows architecture-dependent gains on LLMs
Researchers have developed PALS (Percentile-Aware Layerwise Sparsity), a novel method for pruning large language models (LLMs) that tailors sparsity ratios to individual layers. Unlike previous methods that applied unif…
-
New pruning method preserves LLM reasoning performance
Researchers have developed a new training-free method called Causal Attribution Pruning (CAP) to reduce the size of large language models while preserving their reasoning capabilities. CAP identifies and prunes less cri…
-
New research quantifies error propagation in compressed transformers
Researchers have developed a method to better understand and manage error propagation in compressed transformer models. By measuring the ratio of output to input error (rho) at each layer, they found that errors accumul…