DCLM
PulseAugur coverage of DCLM — every cluster mentioning DCLM across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
New 2D Positional Encoding Method Boosts LLM Copying Ability
Researchers have identified a significant limitation in current large language models, even those considered "frontier" models, which struggle with the simple task of exactly copying input text within their context wind…
-
Scaling LLMs improves social simulations, but with limitations
A new research paper explores the impact of scaling Large Language Models (LLMs) on their ability to perform social simulations. The study found that increasing the compute scale of LLMs, specifically using the Qwen3 ar…
-
Spokes framework boosts AI pretraining data diversity by 489%
Researchers have developed a new probabilistic diversification framework called Spokes, which optimizes for diversity in pretraining data selection. This method utilizes the G-Vendi score and exponentiated gradient desc…
-
Researchers track attention circuit formation in 1B-class language models
A new research paper investigates the emergence of attention circuits in language models, specifically tracking how different types of attention heads form across various model architectures and training datasets. The s…