Subspace Networks

MAPL method enhances LLM training efficiency via learned compression

Researchers have developed Manifold Aware Projection Learning (MAPL), a novel method to improve communication efficiency in pipeline parallelism for training large language models. MAPL treats inter-stage compression as…