The Kapitsa inference engine, optimized for Apple Silicon, has released an update (0.2.26) that improves performance for several large language models. Notably, Qwen Flash-Next 180B now offers faster prompt reading and can run with SSD offloading on systems with less RAM. The engine also supports running models like Clover 35B locally, with benchmarks showing competitive token generation speeds across various models and context lengths on a MacBook Pro M5 Max. AI
IMPACT Enhances local LLM execution on Apple Silicon, enabling larger models and faster inference for users.
RANK_REASON Update to an open-source inference engine for local LLM execution.
- Apple Silicon
- Clover 35B
- Flint40B
- Kapitsa
- M5 Max 2026
- MacBook Pro
- Nemotron Bolt 74B
- Qwen 27B
- Qwen 35B
- Qwen Flash-Next 180B
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →