OLMo 1B
PulseAugur coverage of OLMo 1B — every cluster mentioning OLMo 1B across labs, papers, and developer communities, ranked by signal.
-
LLM inference efficiency explored via quantization, memory, parallelism, and scheduling
Researchers are exploring various methods to enhance the efficiency and scalability of Large Language Model (LLM) inference. One approach focuses on energy efficiency through quantization techniques, demonstrating signi…
-
New Arkios language model trained on English-Nepali text
Researchers have introduced Arkios, a 1.04 billion parameter language model trained on 150 billion tokens of English and Nepali text. The model utilizes a custom training stack and a Devanagari-aware tokenizer. Evaluati…
-
LLM research probes parameter importance, prompting complexity, and task-dependent robustness
Recent research explores the intricacies of large language models (LLMs) and their parameters. One study reveals that "Super Weights," crucial for model performance when intact, become detrimental when trained in isolat…
-
New method validates LLM circuits using ablation tests
Researchers have developed a new method for discovering circuits within large language models by clustering attention head co-activation statistics. This approach, termed "closure-validated circuit discovery," uses caus…