AdaDSF

New framework sparsifies LLMs without full retraining

Researchers have developed an Adaptive Depth Sparse Framework (AdaDSF) to reduce the inference costs of large language models without extensive retraining. This framework leverages the varying importance of different la…