Shenxi Wu

New framework predicts hyperparameter transfer laws for neural networks

Researchers have developed a new framework called Hyperparameter Transfer Laws to better understand and predict how hyperparameters should be adjusted when scaling neural network architectures. This framework introduces…