Neural Scaling Laws
PulseAugur coverage of Neural Scaling Laws — every cluster mentioning Neural Scaling Laws across labs, papers, and developer communities, ranked by signal.
-
Particle physics models engineered for data-driven scaling laws
Researchers are exploring how to engineer scaling laws for models in particle physics, drawing parallels to large language models. Unlike natural language or image domains, fundamental physics benefits from high-fidelit…
-
Deep Learning's statistical properties explored from a physics perspective · arXiv paper
A new paper published on arXiv explores the statistical properties of deep learning, contrasting its performance with classical statistics. The research examines key features and surprising aspects of deep learning from…
-
Neural scaling laws optimize AI for heart imaging analysis
Researchers have applied neural scaling laws, a technique typically used for large language models, to optimize neural networks for medical image segmentation. By extrapolating performance from smaller data subsets, the…
-
Unified Neural Scaling Laws proposed by Mila, U. Montreal, Google DeepMind
Researchers from Mila, the University of Montreal, and Google DeepMind have introduced a unified framework for Neural Scaling Laws. This research aims to explain performance changes during model, data, and compute scali…
-
New method enables generalizable neural scaling laws across domains
Researchers have developed a method to create generalizable neural scaling laws that can be applied across different domains. These laws predict the relationship between model performance and resources like data or comp…
-
New research links optimizer choice to reduced forgetting in LLM finetuning
Researchers have explored the impact of optimizer consistency during the fine-tuning of large language models. One study suggests that using the same optimizer for both pre-training and fine-tuning leads to less knowled…