ENTITY
ReLoRA
ReLoRA
PulseAugur coverage of ReLoRA — every cluster mentioning ReLoRA across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
1 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
1 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
New sMuon method enhances low-rank fine-tuning for neural networks
Researchers have developed a new method called sMuon to improve parameter-efficient fine-tuning (PEFT) of neural networks. This technique addresses the incompatibility between the Muon optimizer and the common LoRA PEFT…
-
LLM pre-training research explores sparse vs. dense and low-rank methods
Two new research papers explore efficient pre-training methods for large language models. The first paper compares dense and sparse Mixture-of-Experts (MoE) transformer architectures at a small scale, finding that MoE m…