Wei Shen
PulseAugur coverage of Wei Shen — every cluster mentioning Wei Shen across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Muon optimizer shows promise in theoretical and practical neural network training
Two new research papers explore the Muon optimizer, an approach designed to better handle matrix-structured parameters in neural networks. The first paper introduces a matrix-aware geometry for Sharpness-Aware Minimizat…
-
Wei Shen discusses decolonizing cyberspace on Mastodon
Wei Shen presented on "Extra-Terrestrial Imageology – Decolonialising the Cyberspace in the Era of Techno Feud." The discussion, moderated on Mastodon, explored themes of decolonialization within cyberspace amidst a bac…
-
New methods enhance LLM adaptation with efficient, structured low-rank tuning
Researchers have introduced MLorc, a novel method for memory-efficient adaptation of large language models that compresses parameter momentum during training. This approach aims to reduce memory demands without sacrific…