OLMo-2-7B
PulseAugur coverage of OLMo-2-7B — every cluster mentioning OLMo-2-7B across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
DNA foundation models connect to LLMs without training via novel 'socket' method
Researchers have developed a novel method to connect DNA foundation models with large language models (LLMs) without requiring extensive training. This approach, termed a "socket," utilizes a closed-form map, specifical…
-
LLM probability updates affected by framing and elicitation methods
A new research paper explores how large language models (LLMs) update their probability estimates based on new information. The study found that LLMs generally adjust their probabilities in the correct direction when pr…
-
Projected Distillation Enhances AI Learning on Difficult Problems
Researchers have developed a new method called "projected distillation" to improve on-policy learning for AI models, particularly in scenarios where all attempts to solve a problem fail. This technique minimally edits t…
-
LLMs show reduced sensitivity to evidence when information is reported
A new study investigated how large language models (LLMs) update their probability estimates based on new information, using the delta-SNLI dataset. Researchers found that when models were directly presented with new ev…
-
Projected Distillation Enhances AI Learning on Complex Tasks
Researchers have introduced "projected distillation," a novel approach to on-policy learning for AI models, particularly effective for complex tasks where initial attempts often fail. This method minimally edits a model…
-
Shared circuit identified as root of AI model biases
Researchers have identified a shared circuit within language models that is responsible for biases, such as sycophancy, where models tend to follow incorrect cues in multiple-choice questions. This circuit, present in p…
-
STAPLE method enhances LLM capacity with static sparse memory
Researchers have developed STAPLE, a novel method for integrating static sparse memory into pretrained language models. This approach enhances model capacity without a proportional increase in computational cost, outper…
-
New LLM Quantization Techniques Boost Efficiency and Accuracy · 5 sources tracked
Researchers are developing new methods to quantize large language models (LLMs) to reduce their size and improve inference speed. Item [1] introduces Distributionally Robust Quantization (DRQ), a refinement process that…
-
Apple ML Research explores LLM agents, translation, speech, and safety
Apple's Machine Learning Research division has published several papers detailing advancements in AI. One paper introduces SelfCompact, a system that allows language model agents to autonomously manage their context by …
-
Frontier LLMs show stereotypes but don't always apply them to users
A recent analysis explored how large language models form opinions of their users and whether these perceptions influence their behavior. Smaller open-source models like Llama-3.2-3B and Qwen2.5-7B exhibited stereotypic…
-
LLMs retain stereotypes but struggle to apply them to user interactions
A recent study explored how large language models (LLMs) form and act upon stereotypes. Researchers found that smaller open-source models like Llama-3.2-3B and Qwen2.5-7B exhibited stereotypical behavior, for instance, …
-
New FPO method adapts LLMs without backward pass, boosting throughput
Researchers have developed a new method called Forward-Pass-Only (FPO) training that adapts large language models without requiring a backward pass through the model's layers. This technique achieves significantly highe…
-
LLM linguistic competence drives left-right brain activity prediction asymmetry
Researchers have identified a left-right asymmetry in how large language models (LLMs) predict human brain activity, which emerges as the models develop formal linguistic competence. This asymmetry, observed using fMRI …
-
New Decan metric measures creative text diversity using language models
Researchers have introduced a new metric called Decan ($D_{Ca_n}$) to measure the diversity of creative text outputs. This method utilizes in-context learning from a single forward pass of a language model, eliminating …
-
LLMs show significant bias in conflict monitoring, not ready for deployment
A new paper evaluates several large language models for their suitability in conflict monitoring tasks in West Africa. The study found that open-weight models like Gemma 3 4B and Llama 3.2 3B exhibit significant biases,…
-
New research reveals loss-critical channels in LLM feed-forward layers
Researchers have identified a specific organizational structure within the feed-forward layers of Large Language Models (LLMs), termed "supernodes" and "halos." These supernodes represent a small percentage of channels …