Yu-Chen Lu

New SkipCat framework compresses LLMs with improved accuracy

Researchers have developed SkipCat, a novel framework for compressing large language models (LLMs) to make them more suitable for devices with limited resources. SkipCat employs an intra-layer shared low-rank projection…