SparseGPT

New PALS pruning method shows architecture-dependent gains on LLMs

Researchers have developed PALS (Percentile-Aware Layerwise Sparsity), a novel method for pruning large language models (LLMs) that tailors sparsity ratios to individual layers. Unlike previous methods that applied unif…