Llama3.1-405B

New methods enable federated LLM fine-tuning via semantic consensus and CLAIR

Researchers have developed novel methods for federated fine-tuning of large language models, moving beyond traditional parameter aggregation. One approach focuses on exchanging model outputs on a shared prompt set to ac…