PulseAugur
EN
LIVE 20:14:38

llama.cpp b9994 adds Q2_0 support for Apple Silicon

The latest release of llama.cpp, version b9994, introduces support for Q2_0 quantization on macOS and iOS. This update specifically targets Apple Silicon hardware, with options for both standard and KleidiAI-enabled configurations. AI

IMPACT Improves efficiency for running large language models on Apple devices.

RANK_REASON This is a software update for an open-source tool, not a frontier model release or significant industry event.

Read on Mastodon — sigmoid.social →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

llama.cpp b9994 adds Q2_0 support for Apple Silicon

COVERAGE [1]

  1. Mastodon — sigmoid.social TIER_1 English(EN) · [email protected] ·

    🚀 llama.cpp b9994 is out metal : add Q2_0 support (#25419) · · macOS/iOS: - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED

    🚀 llama.cpp b9994 is out metal : add Q2_0 support (#25419) · · macOS/iOS: - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS… ⭐ 120,294 stars All open-source AI releases → https:// opensourceai.tech/releases.html # OpenSource # Release …