Noam Razin

Deep learning theory advanced by rank-based generalization analysis · arXiv research

A new thesis proposes that notions of rank are fundamental to understanding deep learning, particularly concerning generalization and expressiveness. The research establishes that gradient-based training can implicitly …