SeedLM

Apple's SeedLM compresses LLM weights using pseudo-random generators

Researchers have developed SeedLM, a novel post-training compression technique for large language models that utilizes pseudo-random generator seeds to encode model weights. This method aims to reduce the high runtime c…