Radio ffn
PulseAugur coverage of Radio ffn — every cluster mentioning Radio ffn across labs, papers, and developer communities, ranked by signal.
No coverage in the last 90 days.
-
DomLoRA method places single adapter at dominant module for efficient fine-tuning
Researchers have developed a new method called DomLoRA for parameter-efficient fine-tuning of large language models. This technique identifies a single "dominant adaptation module" within a model where placing a low-ran…
-
New meta-learning LLM uses hypernetwork for adaptive textual conditioning
Researchers have developed a novel meta-learning approach for Large Language Models (LLMs) that addresses issues of corpus heterogeneity and condition changes. This method utilizes a hypernetwork to dynamically generate…
-
State Stream Transformer V2 enhances LLM reasoning with parallel training and latent state streaming
Researchers have developed the State Stream Transformer (SST) V2, an architectural innovation designed to enhance latent space reasoning in language models. Unlike standard transformers that reset context at each step, …
-
New diagnostic tool probes LLM circuits for safety and behavior insights
A new research paper introduces "Perturbation Probing," a diagnostic method for understanding the internal workings of large language models. This technique uses two forward passes per prompt to identify and analyze "be…
-
Graph Memory Transformer replaces FFNs with learned memory graphs for interpretability
Researchers have developed a Graph Memory Transformer (GMT) that replaces the standard Feed-Forward Network (FFN) sublayer in decoder-only language models with an explicit learned memory graph. This new architecture, GM…
-
Hugging Face introduces Graph Memory Transformer replacing FFNs with learned memory graphs
Researchers have developed a Graph Memory Transformer (GMT) that replaces the standard Feed-Forward Network (FFN) sublayer in decoder-only transformers with an explicit learned memory graph. This new architecture mainta…