A new open-source engine called TurboFieldfare allows users to run the Gemma 4 26B instruction-tuned model on Macs with as little as 2GB of RAM. Developed in Swift and Metal, the engine keeps the core model and KV cache in memory while streaming necessary experts from SSD, significantly reducing memory requirements. This approach enables the large language model to operate on Apple Silicon Macs, even those with only 8GB of unified memory, making advanced AI capabilities more accessible on consumer hardware. AI
IMPACT Enables running large language models on consumer hardware with significantly reduced memory footprints.
RANK_REASON The cluster describes a new open-source engine that enables running a large language model on consumer hardware with limited resources, rather than a new model release or frontier research.
Read on Hacker News — AI stories ≥50 points →
- Apple Silicon
- Gemma 4 26B-A4B
- llama.cpp
- M2 MacBook Air
- Mac
- macOS
- Metal
- Mlx
- OpenAI
- Swift
- TurboFieldfare
- 2GB RAM
- Gemma 4: 26b
- M-series Mac
- Ollama
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →