Pythia-1.4B
PulseAugur coverage of Pythia-1.4B — every cluster mentioning Pythia-1.4B across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
New Arkios language model trained on English-Nepali text
Researchers have introduced Arkios, a 1.04 billion parameter language model trained on 150 billion tokens of English and Nepali text. The model utilizes a custom training stack and a Devanagari-aware tokenizer. Evaluati…
-
New ReSAE Method Enhances Transformer Model Interventions
Researchers have developed Residualized Sparse Autoencoders (ReSAEs) to improve multi-layer interventions in transformer models. Unlike traditional methods that train layers independently, ReSAEs account for the strong …
-
Self-training restructures language models, research finds
A new research paper challenges the common understanding of self-training in language models, suggesting it restructures rather than flattens language. The study found that while surface-level linguistic features like d…