Tiberiu Musat

Neural network grokking explained by norm minimization

Researchers have proposed a new framework to understand the phenomenon of "grokking" in neural networks, where generalization occurs significantly after training data memorization. Their work suggests that this delayed …