ENTITY
OLMoE 1B-7B-0924
OLMoE 1B-7B-0924
PulseAugur coverage of OLMoE 1B-7B-0924 — every cluster mentioning OLMoE 1B-7B-0924 across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
2 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
AI research questions expert importance metrics in MoE models
A new research paper investigates the effectiveness of interpretability methods in Mixture-of-Experts (MoE) models. The study found that common metrics used to predict which experts can be removed without impacting perf…
-
Researchers track attention circuit formation in 1B-class language models
A new research paper investigates the emergence of attention circuits in language models, specifically tracking how different types of attention heads form across various model architectures and training datasets. The s…