The llama.cpp project has released version b12245, which addresses an issue where the iGPU lazy-mode fallback was incorrectly applied when mmap was disabled. This fix ensures that llama_prefetch_rows functions correctly by only disabling lazy-mode when mmap is explicitly turned off, preventing inefficient page-by-page faulting of large tensor rows. The change was tagged by oscarmherrera and resolves issue #31943. AI
IMPACT Improves performance and stability for users of the llama.cpp project, particularly those utilizing integrated graphics.
RANK_REASON This is a software update for a specific tool, not a frontier release or significant industry event.
Read on llama.cpp — Releases →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →