The llama.cpp project has released version b11786, which includes updates to its ggml-cpu compute kernels. These changes focus on improving the calculation of f32 gelu_quick and geglu_quick functions by removing the need for an fp16 table, and also introduce a VXE gelu_quick path. The release also features expanded testing for these CPU kernels and notes compatibility across various operating systems including macOS, Linux, Android, and Windows, with specific mentions of Apple Silicon and openEuler. AI
IMPACT Performance enhancements in llama.cpp's compute kernels may lead to faster local inference for compatible models.
RANK_REASON Software release for a specific project (llama.cpp) with performance improvements to compute kernels.
Read on llama.cpp — Releases →
- android
- Apple Silicon
- Claude Sonnet 5.5
- f32 gelu_quick
- geglu_quick
- ggml-cpu
- Linux
- llama.cpp
- macOS
- Microsoft Windows
- openEuler
AI-generated summary · Google Gemini · from 3 sources. How we write summaries →