Mamba-130M

LiMuon optimizer cuts training costs for large AI models

Researchers have introduced LiMuon, a novel optimizer designed to enhance the efficiency of training large machine learning models. This new optimizer builds upon the existing Muon framework by incorporating momentum-ba…