Mininglamp AI has developed Cider, a new SDK that enhances the MLX framework by adding W8A8 activation quantization. This optimization significantly speeds up the prefill process for large vision-language models on Apple Silicon, reducing prefill time from 2.84s to 2.52s on an M5 Pro chip. The SDK utilizes custom Metal kernels and offers performance improvements for models running through MLX, though INT8 TensorOps are limited to M5 processors and above. AI
Summary written by gemini-2.5-flash-lite from 1 sources. How we write summaries →
IMPACT Improves inference speed for AI models on Apple Silicon, potentially accelerating local AI development and deployment.
RANK_REASON This is a software tool release that enhances an existing framework, not a core model release or significant industry-wide event.
