Jet-Nemotron
PulseAugur coverage of Jet-Nemotron — every cluster mentioning Jet-Nemotron across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Jet-Long method boosts LLM long-context performance without retraining
Researchers have introduced Jet-Long, a novel method for extending the context window of large language models without requiring retraining. This tuning-free, zero-shot approach dynamically adjusts rescaling factors to …
-
New method restores long-context recall lost during LLM fine-tuning
Researchers have identified that Chain-of-Thought (CoT) fine-tuning, while improving reasoning, significantly degrades long-context recall in hybrid linear-attention models. This issue, termed "attention amnesia," cause…
-
DASH framework drastically cuts LLM hybrid attention search time
Researchers have developed DASH, a novel framework for efficiently designing hybrid attention architectures in large language models. This differentiable approach significantly speeds up the architecture search process,…