Fp8
PulseAugur coverage of Fp8 — every cluster mentioning Fp8 across labs, papers, and developer communities, ranked by signal.
9 day(s) with sentiment data
-
LLM inference optimization research details cost-quality-latency trade-offs · 2 sources tracked
Two new research papers explore the trade-offs between inference optimization techniques for large language models (LLMs), focusing on cost, quality, and latency. The first paper, "The Inference Engineering Pareto Atlas…
-
NVIDIA unveils cuDNN Graph API for optimized AI computation graphs
NVIDIA has introduced the cuDNN Graph API, a new feature within its cuDNN Frontend that allows developers to define computations as graphs of operations. This API enables cuDNN to automatically select and optimize execu…
-
7 PhD students train 7B LLM from scratch using hundreds of AI agents
Seven doctoral students from Beijing Zhongguancun Academy successfully trained a 7B large language model, ZGCM-1, from scratch in just three months. They achieved this by leveraging a team of hundreds of AI agents to ha…
-
New attention quantization speeds up tabular foundation models
Researchers have developed a new attention quantization strategy for tabular foundation models to improve inference performance. This method focuses on quantizing queries, keys, and values to FP8, leveraging explicit FP…
-
Open-source ZGCM-1 model achieves high efficiency in math and agentic search
Researchers have introduced ZGCM-1, a 7B parameter foundation model designed for mathematical reasoning and agentic search. The model leverages an efficient training recipe that combines architectural innovations like i…
-
Together AI optimizes ThunderKittens for NVIDIA Vera Rubin Blackwell GPUs
Together AI has gained access to NVIDIA's Vera Rubin NVL72 platform, which is based on the Blackwell architecture. Their team has updated their ThunderKittens software to leverage new features of the Vera Rubin chip, sp…
-
NVIDIA releases GLM-5.3-Flash and Qwen3.8-27B for Blackwell systems
NVIDIA has released two new models, GLM-5.3-Flash and Qwen3.8-27B, optimized for their Blackwell systems. GLM-5.3-Flash, a 320B MoE model with 18B active parameters, supports multimodal tasks and a 1M context window, re…
-
StableDiffusion user compares text encoder precision in FLUX.2-Dev
A user on Reddit's r/StableDiffusion subreddit shared their experience testing the impact of text encoder precision on image generation using FLUX.2-Dev. They compared bfloat16 (bf16) and 8-bit floating-point (fp8) prec…
-
New FlashAttention-4 method boosts FP4 performance on Blackwell hardware
Researchers have developed a new method called Direct-P to optimize FlashAttention-4 for Blackwell's 4-bit floating-point (FP4) tensor cores, addressing performance bottlenecks caused by softmax conversion and on-chip d…
-
Qwen3.8 27B model hits 280 tok/s with new MXFP4 optimization
A developer has achieved significant performance gains with the Qwen3.8 27B model by implementing MXFP4 kernels on dual R9700 GPUs. This optimization, which utilizes W4A8 quantization, has reportedly surpassed FP8 perfo…
-
A.X K2 language model debuts with 688B parameters and agentic focus
A new technical report introduces A.X K2, a 688 billion parameter Mixture-of-Experts (MoE) language model designed for agentic applications. Despite being trained on fewer tokens than its predecessor, A.X K1, A.X K2 dem…
-
LinkedIn unveils new GPU retrieval for semantic search
Researchers have developed a new retrieval framework for semantic search on LinkedIn, aiming to improve the relevance of profile suggestions for users. The system partitions embeddings into eight category-supervised seg…
-
DeepSeek releases first multimodal vision model, DeepSeek-V4-Flash-Vision-Exp
DeepSeek has released its first experimental multimodal model, DeepSeek-V4-Flash-Vision-Exp, which integrates visual capabilities into its V4-Flash architecture. This new model offers enhanced performance on multimodal …
-
Alibaba's Qwen team announces new architecture support with TokenSpeed
Alibaba's Qwen team announced support for their new architecture, including GDN + QSA, N-gram embedding, and FP8 precision. This support was provided by lightseekorg, which offered day-0 integration for TokenSpeed. The …
-
Qwen3.8-Flash-Next-FP8 VLM Features 125B Parameters and Gated DeltaNet
Qwen3.8-Flash-Next-FP8 is a 125 billion parameter VLM that utilizes 6 billion active MoE units and a Gated DeltaNet architecture. This FP8 variant is distributed across 131 safetensors shards and supports advanced funct…
-
SGLang bug causes endless repetition in FP8 lm_head models
A bug in SGLang versions prior to commit 5375babb causes endless repetition and empty responses when serving models with FP8 lm_head configurations, such as unsloth/Qwen3.8-27B-NVFP4. This issue arises because SGLang in…
-
New KV cache compression techniques aim to boost LLM long-context performance
Researchers are developing new methods to compress the key-value (KV) cache in large language models, a major bottleneck for long-context inference. Minima-KV uses a mixed-format approach, storing recent pages in FP8 an…
-
Stable Diffusion gets speed boost with new Sparse Attention backend
A new backend for Stable Diffusion's attention mechanism, called Sparse Attention, has been developed, offering performance improvements and reduced VRAM usage. This optimization, available through custom nodes for Comf…
-
LLM Quantization: More Than Just Bit Reduction
Quantization in large language models is a complex process involving more than just reducing bit precision. It encompasses four key decisions: notation, format, evaluation, and the resulting capacity gains. Different qu…
-
Qwen3.8-27B achieves 29/30 on AIME 2026 math benchmark with FP8
A benchmark test of the Qwen3.8-27B model on the AIME 2026 math dataset revealed that its quantized FP8 weights, when set to xhigh reasoning effort, achieved a score of 29/30. This performance was comparable to the BF16…