Yu-Yang Qian

TreeLoRA offers efficient continual learning for large models

Researchers have introduced TreeLoRA, a novel approach for efficient continual learning in large pre-trained models. This method utilizes layer-wise Low-Rank Adapters organized by a hierarchical gradient-similarity tree…