PreLort

PreLort Method Enhances Federated Fine-Tuning for LLMs

Researchers have introduced PreLort, a novel method for federated fine-tuning of large language models that addresses challenges posed by heterogeneous hardware. PreLort utilizes a prefix-nested low-rank formulation to …