ggml-org
PulseAugur coverage of ggml-org — every cluster mentioning ggml-org across labs, papers, and developer communities, ranked by signal.
5 day(s) with sentiment data
-
llama.cpp adds ARM NVFP4 dot product optimization via UE4M3 LUT
A pull request for the llama.cpp project introduces an optimization for ARM processors by extending the UE4M3 lookup table (LUT) to the NVFP4 dot product implementation. This change aligns the ARM version with existing …
-
llama.cpp adds -ffast-math flag for HIP builds, boosting performance
A pull request for the llama.cpp project introduces the ggml-hip library, enabling the use of the -ffast-math compiler flag for HIP builds. Benchmarks on an RDNA3.5 GPU show a performance increase of up to 7% for the Qw…
-
llama.cpp adds multi-layer MTP support via new pull request
A pull request has been submitted to the llama.cpp project to add support for Step3.5/3.7 flash MTP3. This update builds upon previous work and introduces multi-layer MTP support, encouraging users to try it with the la…
-
Georgi Gerganov praises Qwen3.6-27B for local coding tasks
Georgi Gerganov has found the Qwen3.6-27B model to be highly effective for local coding tasks, utilizing it daily for mundane maintenance work at ggml-org. He primarily runs the model on his Apple M2 Ultra or an RTX 509…
-
Cohere Labs releases North Mini Code for code generation
Cohere has released North Mini Code, a 30 billion parameter model optimized for code generation and agentic software engineering tasks. This open-weights research model, developed by Cohere and Cohere Labs, features a 3…
-
llama.cpp integrates Gemma 4 MTP for faster local model performance
The llama.cpp project has merged support for Gemma 4 MTP, a feature that enhances the speed and efficiency of local large language models. This integration allows users to leverage Gemma 4 with Quantization Aware Traini…
-
llama.cpp adds support for Step3.7-Flash model
A pull request has been submitted to the llama.cpp repository to add support for the Step3.7-Flash model. This integration aims to enable local execution of this particular AI model. The request also mentions ongoing wo…
-
llama.cpp CUDA pull request optimizes MMQ stream-k overhead for MoE models
A pull request to the llama.cpp project aims to reduce overhead in CUDA's MMQ stream-k operations. This optimization targets Mixture of Experts (MoE) models, potentially leading to faster prompt processing speeds. The c…