Arie Wortsman-Zurich

New model explains scaling laws from sequential feature learning

Researchers have developed a hierarchical model that explains how scaling laws emerge from feature learning in multi-layer neural networks. This model utilizes a layer-wise spectral algorithm that sequentially recovers …