ENTITY
Model Size
Model Size
PulseAugur coverage of Model Size — every cluster mentioning Model Size across labs, papers, and developer communities, ranked by signal.
Total · 30d
1
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
2 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
LLM pretraining: Optimal domain data repetition linked to validation loss
A new research paper explores the optimal repetition of domain-specific data during the pre-training of large language models (LLMs). The study found that as models scale and require larger training-token budgets, the o…
-
LLM factual recall scales with model size and training data frequency
Researchers have identified a predictable relationship between factual recall in large language models, their size, and the frequency of topics in their training data. By evaluating 38 models on over 8,900 scholarly ref…