FedSubMuon-GT

New FedSubMuon method slashes LLM federated fine-tuning communication costs

Researchers have developed FedSubMuon, a novel method for federated fine-tuning of large language models (LLMs) that significantly reduces communication costs. This approach optimizes compact coefficient matrices within…