TokCode

New methods compress LLM sequences for efficiency and semantic recovery

Researchers have developed new methods to compress sequences in large language models (LLMs) to reduce computational costs and improve efficiency. FastE, a training-free method, compresses prefix states in embedding mod…