The llama.cpp project has released version 1.0.0, introducing significant security enhancements to its server functionality. This update includes hardening against Server-Side Request Forgery (SSRF) and DNS rebinding attacks, with new opt-in requirements for tools when binding to non-loopback addresses. Additionally, the release incorporates advanced hardware acceleration features such as CUDA FP8, Vulkan, and Intel flash attention, alongside Hexagon Q5 quantization for improved performance. AI
IMPACT Improves performance and security for local LLM inference, potentially enabling wider adoption of self-hosted models.
RANK_REASON This is a software release for a tool that facilitates running large language models, not a frontier model release or core AI research.
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →