Ollama has released version v0.32.10-rc0, introducing optimizations for double-scale NVFP4 models. This update compiles multiply and cast operations into a single kernel, reducing overhead from separate eager ops. Benchmarks on an M5 Max show a performance increase of approximately 6.7% to 7.9% for prefill operations on models like Qwen3.6-27B and muse-glimmer:30b, while speculative decoding performance remains unaffected. AI
IMPACT Improves inference speed for specific model types, potentially benefiting users running local LLMs.
RANK_REASON This is a software release for an open-source tool that improves performance but does not represent a new frontier model or significant industry shift.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
