DFlash2
PulseAugur coverage of DFlash2 — every cluster mentioning DFlash2 across labs, papers, and developer communities, ranked by signal.
- 2026-10-30 product_launch The DFlash2 draft head was released for the Qwen3.8-Flash-Next model, offering performance improvements. source
6 day(s) with sentiment data
-
DSpine speculative decoding method sees GGUF releases and llama.cpp integration
The DSpine speculative decoding method has seen recent updates, including the release of GGUF model files and an open pull request for llama.cpp. These GGUFs, available on Hugging Face, offer comparisons with the DFlash…
-
New TVP loss function enhances speculative decoding for faster LLM inference
Researchers have developed TVP, a novel loss function family designed to improve speculative decoding in large language models. This method aims to accelerate inference by optimizing the acceptance rate of proposed toke…
-
DFlash2 draft head boosts Qwen3.8-Flash-Next speed by 17%
A new draft head called DFlash2 has been released for the Qwen3.8-Flash-Next model, offering significant speed improvements over the previous MTP draft head. Benchmarks show an average increase of 17% in tokens per seco…
-
Qwen 3.8 27B model users advised to try lower draft quantizations with DFlash2
A user on Reddit's r/LocalLLaMA community shared a tip for optimizing the performance of the Qwen 3.8 27B model when using DFlash2. The user found that using a lower quantization for the draft model, specifically Q4, re…
-
Qwen3.8 27B: Six inference engines benchmarked on RTX 5090
A comparison of six inference engines—TensorSharp, llama.cpp, vLLM, SGLang, velox-inferer, and NInfer—running the Qwen3.8 27B model on a single RTX 5090 GPU revealed varying performance across different tasks. NInfer ex…
-
llama.cpp adds probabilistic sampling for DFlash2 drafts
The llama.cpp project has released an update, tagged b11834, which enhances probabilistic sampling for DFlash2 drafts. This update was co-authored by Pranesh Gonegandla, who is affiliated with Nvidia. The release focuse…
-
EAGLE-4 optimization technique shows significant speedup over DSpark and DFlash2
A new model optimization technique called EAGLE-4 has been released, demonstrating significant speed improvements over existing methods like DSpark and DFlash2. Early benchmarks show EAGLE-4 achieving a 3.59x speedup ov…
-
Reflection AI open-sources 501B Beam model and training harness
Reflection AI has released Beam, a 501 billion parameter open-weight model, under the permissive Apache 2.0 license. Alongside the model weights, the company has also open-sourced Mirror CLI, their training harness, whi…
-
HyperQwen stack hits 118 tok/s on RTX 3090, but high-perf mode crashes
A developer tested the HyperQwen stack on a single RTX 3090, achieving 118 tokens/second for chat and 237 tokens/second for verbatim context quoting. This performance significantly surpasses the 42 tokens/second baselin…
-
Hugging Face releases Beam, a 501B parameter open MoE model with 1M context
Hugging Face has released Beam, a 501 billion parameter Mixture-of-Experts (MoE) large language model designed for coding and agentic tasks. Beam boasts a 1 million token context window and features a unique architectur…
-
BAAI's AREX-2 model requires careful serving despite Qwen architecture
The Beijing Academy of Artificial Intelligence (BAAI) has released AREX-2, a 27B parameter model based on the Qwen architecture. While its configuration file initially appears identical to Qwen3.8-27B, subtle difference…
-
New Ninfer 4080 system enables 100k context LLM on 16GB GPU
A software engineer has developed Ninfer 4080, a system designed to run the ISTA-DASLab-Qwen-3.8-27B-GSQ model on an RTX 4080 GPU with 16GB of memory. This new system aims to significantly improve prefill and token gene…
-
NCP-ArchPreview model advances language modeling with concept prediction
Researchers have introduced NCP-ArchPreview, a novel latent-space language model that moves beyond traditional next-token prediction. This model incorporates Next Concept Prediction (NCP), enabling it to learn and predi…
-
4-bit quantization enables large AI models on single 3090 GPU
A user on Mastodon shared their positive experience using 4-bit quantization for AI models, noting that a single 3090 GPU could fully accommodate a model with a 128k context window and the DFlash2 model. They reported i…
-
Qwen3.8 27B model hits 280 tok/s with new MXFP4 optimization
A developer has achieved significant performance gains with the Qwen3.8 27B model by implementing MXFP4 kernels on dual R9700 GPUs. This optimization, which utilizes W4A8 quantization, has reportedly surpassed FP8 perfo…
-
llama.cpp integrates DFlash2 for improved local LLM performance
The llama.cpp project has integrated support for DFlash2, a new technique that enhances local convolution and candidate selection. This merge, identified as Pull Request #27342, was contributed by SubSir and is now part…
-
DFlash2 speculative decoding boosts Qwen3.8-27B speed on consumer GPUs
A user on Reddit shared a guide for optimizing the Qwen3.8-27B large language model's performance on consumer hardware. The method, called DFlash2 speculative decoding, pairs a smaller "drafter" model with the main mode…
-
Alibaba Qwen releases new recipes with NVFP4 and DFlash2 for Qwen3.8-27B model
Alibaba's Qwen team has released new recipes for their Qwen3.8-27B model, integrating NVFP4 and DFlash2 technologies. These recipes are now available in the SGLang cookbook, providing users with starting points for expe…
-
vLLM releases 0.28.0rc2 with DFlash2 performance enhancements
vLLM has released version 0.28.0rc2, introducing the DFlash2 system. This update incorporates a local convolution method combined with a candidate selector to enhance performance. The release includes contributions from…
-
DFlash2 optimization boosts Qwen 3.8-27B model speed up to 4x
A new optimization technique called DFlash2 has been integrated into llama.cpp, significantly boosting the performance of the Qwen 3.8-27B model. Benchmarks show DFlash2 can accelerate decoding speeds by up to 3 times o…