Databricks Dolly-15K

New MoE methods enhance federated LLM tuning for private data

Researchers have developed new methods for federated instruction tuning of Mixture-of-Experts (MoE) Large Language Models (LLMs) to handle decentralized and private data. One approach, ClientMorpher, uses MoE router sig…