Moritz Wagner

LLM pruning adaptation method matches retraining with less compute

Researchers have developed a new method for adapting pruned Large Language Models (LLMs) called local reconstruction. This technique involves adapting subsets of model parameters one at a time to match the original dens…