SVD-LLM(W)

New AIR framework compresses LLMs using SVD with improved efficiency

Researchers have developed Activation- and Influence-Aware Ranks (AIR), a novel framework for compressing Large Language Models (LLMs) using Singular Value Decomposition (SVD). AIR integrates a backward-signal influence…