Entropic Gradient Descent (EGD)

New theory links entropy to deep learning limits, proposes EGD algorithm

Researchers have introduced a new theoretical framework that links information theory, topology, and statistical mechanics to understand the limits of learnability in deep neural networks. This framework defines an Entr…