Shirin Alanova

LLM activation pruning shows promise for next-gen hardware accelerators

A new research paper explores lightweight methods for post-training activation pruning in large language models, finding that this technique preserves generative capabilities better than weight pruning at equivalent spa…