MaskLLM

PATCH framework enables learnable hybrid sparsity for LLMs

Researchers have developed PATCH, a novel hybrid sparsity framework designed to reduce the memory and compute costs associated with large language models (LLMs). This method allows for a continuous sparsity ratio betwee…