PrismML has released Bonsai 27B, a 27-billion-parameter large language model capable of running offline on mobile devices like the iPhone 17 Pro Max. The model achieves its small footprint through a novel 1-bit training approach rather than traditional quantization, resulting in a 3.9GB file size. While it maintains strong reasoning and code generation capabilities, it shows degradation in agentic tasks like tool-calling. Bonsai 27B can be accessed via WebGPU in a browser or integrated with OpenAI-compatible clients. AI
IMPACT Enables more powerful AI applications to run directly on mobile devices, enhancing privacy and reducing reliance on cloud infrastructure.
RANK_REASON This is a release of a specific LLM model, but it is from a less prominent lab and not positioned as a frontier release.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
