Nakatsukasa & Freund

New Polar Express method accelerates matrix decomposition for deep learning

Researchers have developed a new GPU-friendly algorithm called Polar Express for computing matrix decompositions, which is crucial for the Muon optimizer used in training deep neural networks. This method optimizes for …