MXFP4
PulseAugur coverage of MXFP4 — every cluster mentioning MXFP4 across labs, papers, and developer communities, ranked by signal.
10 day(s) with sentiment data
-
New BitDecoding-FP4 method boosts LLM serving throughput with FP4 KV cache
Researchers have developed BitDecoding-FP4, a novel algorithm-system co-design for efficient and accurate native FP4 KV cache decoding in large language models. This approach addresses accuracy drops and throughput degr…
-
Open MoE Models Diverge on Routing Details: DeepSeek, Qwen, Llama 4 Compared
A comparison of open Mixture-of-Experts (MoE) models reveals significant divergence in their routing mechanisms, despite a shared core idea. Models vary widely in expert count, ranging from 8 to 384, and the number of e…
-
Kimi K3.1 Pro model precision details revealed as inaccurate
A technical analysis of the Kimi K3.1 Pro model revealed discrepancies in its reported bit precision. While the model page indicated 8-bit precision and the download badge suggested the same, a detailed calculation base…
-
Hydrogen-1.0 scientific model challenges GPT-6 Astra with lower costs
Deep Principle has released Hydrogen-1.0, an open-weight scientific model based on GLM-5.3, designed for chemistry, materials science, and life sciences. In evaluations, Hydrogen-1.0 reportedly outperformed GPT-6 Astra …
-
New calibration methods enhance HiFloat4 quantization accuracy for LLMs
Researchers have developed three new calibration approaches—HiGPTQ, HiAutoRound, and HiFlatQuant—to improve the accuracy of large language models quantized using the HiFloat4 (HiF4) format. These methods address the cha…
-
LLM VRAM Needs: Real-world data reveals KV cache impact at 8K context
A new analysis details the actual VRAM requirements for running 26 popular open-weight LLMs at 4-bit precision and an 8K context window. The study found that while weights often constitute the largest portion of memory …
-
llama.cpp b11985 optimizes Metal performance on Apple devices
The llama.cpp project has released version b11985, introducing performance enhancements for Metal on macOS and iOS. This update includes faster MXFP4 matrix-vector multiplication by optimizing fp4 value decoding and rem…
-
llama.cpp b11979 release boosts Arc Pro B70 performance with optimized quantization
The latest release of llama.cpp, version b11979, introduces significant performance optimizations for various quantization formats, particularly on the Arc Pro B70 GPU. These updates focus on vectorizing dequantization …
-
llama.cpp optimizes GEMV kernel with SVE 256-bit MXFP4 implementation
The llama.cpp project has released version b11967, featuring an optimized implementation of the General Matrix Vector Multiplication (GEMV) kernel using MXFP4 and SVE 256-bit instructions. This update, developed in coll…
-
New ALTO recipe enables efficient MXFP4 training for MoE LLMs
Researchers have developed a new training recipe called ALTO for the GPT-OSS-20B mixture-of-experts model, enabling it to train effectively using the MXFP4 sub-8-bit arithmetic format. This approach combines existing te…
-
llama.cpp project releases pre-updates with OS and model optimizations
The llama.cpp project has released several pre-release updates, including b11732 which fixes a CUDA warning and adds support for various operating systems like macOS, iOS, Linux, Android, Windows, and OpenEuler. Release…
-
Modal enables cheaper RL training with mixed-precision, mixed-accelerator samplers
Modal has developed a novel approach to reinforcement learning (RL) for large language models that utilizes mixed-precision and mixed-accelerator samplers. This method addresses the significant cost of sampling in RL by…
-
Unsloth releases beta with command palette and faster Laya decisions
Unsloth has released version 0.1.902-beta, introducing a command palette accessible via Cmd/Ctrl+P and enhancing the desktop UI/UX for faster navigation and clearer error messages. This update significantly speeds up La…
-
Imagination E-series GPUs integrate AI for faster rendering and LLM inference
Imagination Technologies has unveiled its new E-series GPU architecture, designed to integrate AI capabilities directly into graphics processing. This new architecture features a "Neural Core" that can perform AI upscal…
-
New research explores advanced quantization techniques for LLMs · 10 sources tracked
Multiple research papers introduce novel techniques for quantizing large language models (LLMs) to reduce their computational and memory footprints. These methods aim to improve efficiency without significantly sacrific…
-
Xiaomi releases trillion-parameter MiMo LLM family with open weights
Xiaomi has released its MiMo family of large language models, featuring a trillion parameters in its latest MiMo-V2.5-Pro version. These models are notable for their open-weight status under the MIT license and their na…
-
ESTS details WMT26 model compression using GPT-OSS-20B and GPT-5.1
Researchers from ESTS have detailed their submissions to the WMT26 Model Compression Shared Task, focusing on English-to-Simplified Chinese and English-to-Egyptian Arabic translation. Their approach involved pruning exp…
-
NVIDIA releases DeepSeek-V4-Pro-0813 with DSpark-Draft-Head
NVIDIA has released DeepSeek-V4-Pro-0813 as an NVFP4 checkpoint, integrating a DSpark-Draft-Head. This release features MXFP4 experts from the draft module losslessly mapped to NVFP4, ensuring consistent quantization be…
-
New EFQ-Softmax method optimizes low-bit quantization for Transformers
Researchers have developed EFQ-Softmax, a novel method for low-bit quantization in Transformer models that bypasses the traditional exponential calculation for softmax. This approach directly maps shifted attention scor…
-
Scale-QLoRA enables lossless merging of LLM adapters in 4-bit models
A new research paper introduces Scale-QLoRA, a method for merging LoRA adapters into native 4-bit quantized LLMs without accuracy loss. Traditional merging methods can degrade performance, but Scale-QLoRA preserves the …