Pythia-410M
PulseAugur coverage of Pythia-410M — every cluster mentioning Pythia-410M across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Token representation flow in LLMs is nonlinear, study finds
Researchers have analyzed the flow of token representations within neural networks, finding that this flow is nonlinear and does not follow its own density. Using discrete Langevin models on Pythia-160M and Pythia-410M,…
-
FlashAttention-V boosts transformer inference on vector architectures
Researchers have developed FlashAttention-V, an optimized version of FlashAttention tailored for scalable vector architectures. This new method aims to improve the efficiency of transformer models, particularly Small La…
-
New Ignition Index metric measures global workspace dynamics in language models
Researchers have introduced the Ignition Index (I), a new metric designed to quantify global workspace dynamics within language models. This scalar metric operationalizes predictions from Global Workspace Theory (GWT) b…
-
New framework enables user attribution and payload extraction for generative model watermarks
Researchers have developed a new information-theoretic framework for watermarking generative models, enabling more than just machine-made text detection. This framework allows for user attribution, payload extraction, a…
-
Self-training restructures language models, research finds
A new research paper challenges the common understanding of self-training in language models, suggesting it restructures rather than flattens language. The study found that while surface-level linguistic features like d…