Intrinsic dimension

New 'Representation Gap' metric explains neural network generalization

Researchers have introduced a new metric called the Representation Gap to better understand and predict the generalization error of neural networks. This metric, related to asymptotic dynamics, is governed by the task's…