SmallCNN

Fisher Rank Inflation: Memorization Signature in Noisy Deep Learning

Researchers have identified a phenomenon called Fisher Rank Inflation, which serves as a spectral signature for memorization in deep learning models trained with label noise. This inflation occurs when models transition…