PulseAugur
EN
LIVE 20:29:10
ENTITY learning rate

learning rate

PulseAugur coverage of learning rate — every cluster mentioning learning rate across labs, papers, and developer communities, ranked by signal.

Show in brief
Total · 30d
2
5 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
2
5 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 6 TOTAL
  1. TOOL · CL_330917 ·

    New AIR learning rate schedule optimizes weight-normalized AI training

    A new paper introduces the AIR (Affine Inverse-square-Root decay) learning rate schedule, designed to optimize weight-normalized training. This method focuses on controlling the effective learning rate (ELR) rather than…

  2. TOOL · CL_210528 ·

    New theory reframes optimizer stability in deep learning

    Researchers have identified a phenomenon in deep learning where gradient-based optimizers maintain stable Hessian eigenvalues above theoretically predicted instability thresholds. This deviation, observed to be as high …

  3. TOOL · CL_180596 ·

    Research links learning rates to catastrophic overtraining in LLMs

    A new research paper explores how learning rates impact catastrophic overtraining during the supervised fine-tuning (SFT) of large language models (LLMs). The study, published on arXiv, suggests that different learning …

  4. RESEARCH · CL_40767 ·

    New Bayesian Framework Optimizes Neural Network Learning Rates

    Researchers have introduced a novel probabilistic framework to optimize the learning rate in neural network training, moving beyond empirical trial-and-error. This new approach develops classic Bayesian statistics into …

  5. RESEARCH · CL_02845 ·

    Researchers pinpoint origin of neural network 'Edge of Stability' phenomenon

    Researchers have introduced a new concept called the 'edge coupling' to explain the phenomenon known as the Edge of Stability in neural network training. This functional, applied to consecutive iterate pairs, helps to e…

  6. RESEARCH · CL_310574 ·

    AI research spans model tuning, uncertainty estimation, and societal integration

    Researchers are exploring various aspects of AI, from optimizing language models to improving uncertainty estimation in computer vision. One paper investigates the hyperparameter landscape of Direct Preference Optimisat…