PrismML, a startup spun out of Caltech, has developed Bonsai 27B, a 27.8-billion-parameter AI model capable of processing text and images that can run directly on an iPhone. This is achieved through an extreme form of quantization, reducing most parameters to a single bit, which significantly shrinks the model's memory footprint to under 4GB while retaining over 90% of its original performance. While factual recall is impacted, reasoning and coding abilities remain strong, and the on-device operation offers benefits like zero per-query cost, enhanced privacy, and offline functionality, attracting interest from companies like Apple. AI
IMPACT Enables new classes of private, offline AI applications on consumer devices, potentially shifting cloud dependency.
RANK_REASON AI model release with significant technical innovation enabling on-device operation. [lever_c_demoted from significant: ic=1 ai=1.0]
- Apache Software License 2.0
- Bonsai 27B
- California Institute of Technology
- Cerberus
- Hugging Face
- iPhone
- iPhone 15
- iPhone 17 Pro
- Khosla Ventures
- NVIDIA
- PrismML
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
