A new method allows users to run Claude Code locally on Apple Silicon Macs without needing an API key or incurring costs. This setup utilizes the mlx-serve tool to host models like Gemma 4 or Qwen 3.6, enabling features such as streaming, tool calls, and multi-turn conversations through the Anthropic Messages API. The guide highlights that Gemma 4 E4B 4-bit offers approximately 105 tokens/sec decode on an M4 Max, while Qwen 3.6 27B 4-bit achieves around 36 tokens/sec with native MTP spec-decode, making it 1.43x faster for coding tasks. AI
IMPACT Enables local, cost-free execution of advanced AI coding assistants on personal hardware.
RANK_REASON This is a guide on how to use existing tools and models together, rather than a new release from a frontier lab.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
