OLMo-2
PulseAugur coverage of OLMo-2 — every cluster mentioning OLMo-2 across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
AI models learn to read internal states faster than they learn to write them
A new research paper titled "Lagged Coupling: Internal Representations Become Readable Before They Become Causal" explores the development of internal representations in large language models. The study, using the Pythi…
-
Research probes pretraining vs. retrieval trade-offs in language models
A new research paper explores the interplay between pretraining and retrieval in language models, investigating how scaling model capacity and pretraining data affects retrieval gains. The study found that retrieval ben…
-
New Moir method improves LLM knowledge editing by using model's own data
Researchers have developed a new method called Moir for knowledge editing in language models, addressing the issue of degraded reasoning capabilities after editing. Moir estimates the preservation covariance directly fr…
-
New PEFT method mHC enhances Transformer finetuning when combined with LoRA
Researchers have introduced Manifold-Constrained Hyper-Connections (mHC), a novel parameter-efficient finetuning (PEFT) method for Transformer models. This approach modifies residual connections, a component typically l…