long-horizon grokking

Random Matrix Theory detects overfitting in neural networks and LLMs

Researchers have developed a novel method using Random Matrix Theory to detect overfitting in neural networks, particularly during the "anti-grokking" phase of long-horizon training. This technique identifies "Correlati…