Olmo
PulseAugur coverage of Olmo — every cluster mentioning Olmo across labs, papers, and developer communities, ranked by signal.
11 day(s) with sentiment data
-
Research: AI model safety outcomes predictable from first token, not deliberation
A new research paper challenges the assumption that "thinking tokens" in reasoning models inherently improve safety. The study found that the refusal or compliance outcome of models like GPT-OSS, Qwen, Olmo, and Phi is …
-
Bluesky Jetstream enables custom AI models with open Olmo language models
Bluesky's Jetstream platform facilitated the development of custom AI models for regulated industries by thinkaisquared.bsky.social and Domyn. They utilized Olmo, a family of open language models, to build specialized m…
-
New benchmarks tackle privacy risks in large language models
Researchers have developed new methods to evaluate membership inference attacks (MIAs) against large language models (LLMs), particularly focusing on audio and text modalities. The first study introduces a systematic ev…
-
AI Models: Post-Training Recipes and Future Trends Explored
A new podcast episode features Nathan Lambert and Finbarr Timbers discussing recent advancements in AI model post-training techniques. The conversation covers the industry's shift towards multi-teacher on-policy distill…
-
LLM post-training recipes evolve with new distillation techniques
A review of post-training recipes for large language models highlights significant evolution in the past year. Historically, models followed a pipeline of Supervised Fine-Tuning (SFT), reward modeling, and Reinforcement…
-
Google DeepMind Explores Why SFT Filters Fail for LLM Safety
Google DeepMind researchers are investigating why supervised fine-tuning (SFT) filters for safety properties in language models often fail. Their analysis, focusing on Gemini and Olmo, reveals that undesirable traits li…
-
Hugging Face launches olmo-eval for LLM development
Hugging Face has released olmo-eval, a new workbench designed to streamline the iterative process of developing large language models. Building upon the Open Language Model Evaluation Standard (OLMES), olmo-eval simplif…
-
OLMo training stages reveal evaluation-awareness inflation
Researchers investigated the emergence of evaluation-awareness in the OLMo language model, finding that it significantly increases during the Reinforcement Learning from Human Feedback (RLHF) stage. Specifically, the OL…
-
AI transparency debate: 'Open weights' insufficient, requires data and value insight
The article "Open Weights, Closed Minds: What AI Transparency Actually Requires" argues that releasing only model weights, a practice termed "open weights," is insufficient for true AI transparency. While this allows us…
-
Study: Language model circuits vary by architecture
A new study published on arXiv investigates how different language model architectures implement similar task functionalities. Researchers found that the specific circuits responsible for task execution vary significant…
-
AI benchmark auditing methods fail under real-world conditions
A new research paper highlights significant issues with current methods for detecting benchmark contamination in large language models. The study, which evaluated 27 models including frontier industry ones, found that c…
-
Allen Institute for AI project contributor departs
Nathan Lambert has concluded his tenure at the Allen Institute for AI (Ai2). During his over two years with the organization, he contributed to significant projects such as Olmo and Tulu. Lambert expressed gratitude for…
-
New papers explore limits and advantages of large AI models
Two new research papers explore the limitations and advantages of large language models. One paper argues that even with abundant data, there are fundamental limits to adaptation in multitask learning, suggesting that s…
-
LLM popularity bias driven by pretraining data exposure, study finds
Researchers have analyzed how large language models (LLMs) develop preferences for well-known entities, a phenomenon often linked to popularity bias. Using the open OLMo models and their complete Dolma pretraining corpu…