Ouro-1.4B
PulseAugur coverage of Ouro-1.4B — every cluster mentioning Ouro-1.4B across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
Ouro Looped Language Models Show Improved Retrieval Accuracy
Researchers have investigated how later loops in pretrained looped language models, specifically Ouro-1.4B and Ouro-2.6B, can correct two-hop retrieval errors. By transplanting attention queries between loops, they foun…
-
New research suggests agreement, not normalization, enables depth reusability in looped language models
A new research paper proposes that the reusability of depth in looped language models relies on agreement between training and inference loops, rather than state normalization between steps. Experiments on released Ouro…
-
New research reveals challenges in probing LLM latent reasoning
A new research paper explores the challenges of probing latent reasoning in large language models, specifically focusing on how information is represented and accessed within the models. The study used minimal pairs of …
-
Tiny LoRA Fixes Transformer Models' Early Reasoning Stops
A new research paper introduces a method to improve the reasoning capabilities of transformer models by addressing an issue where they stop processing information too early. The researchers developed a small, task-train…
-
Researchers explore adaptive depth and cyclic folding for Transformer optimization
Two new research papers explore novel approaches to optimizing Transformer models by dynamically adjusting their depth. The first paper, "Adaptive Depth in Looped Transformers," investigates learned halting gates and tr…
-
New LLA technique slashes Transformer cache size, boosting capacity
Researchers have developed Looped Latent Attention (LLA), a novel cache compression technique for looped, weight-tied Transformers. LLA exploits the structured, low-rank nature of the Key/Value (K/V) cache across recurr…