PrismML
PulseAugur coverage of PrismML — every cluster mentioning PrismML across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
PrismML will release a tool-calling optimized version of Bonsai within 12 months
The noted degradation in agentic tasks for Bonsai 27B presents an opportunity for PrismML to further refine its model. A future release focusing on improving tool-calling capabilities while maintaining the small footprint could address a key limitation and broaden the model's applicability.
PrismML's Bonsai 27B shows degradation in agentic tasks
The recent release of PrismML's Bonsai 27B highlights a trade-off in its novel 1-bit training approach: while it achieves a significantly smaller footprint for offline mobile use, it exhibits degraded performance in agentic tasks like tool-calling. This suggests that for applications requiring complex multi-step reasoning or interaction with external tools, the current iteration of Bonsai 27B may not be suitable.
PrismML's Bonsai 27B will be integrated into a major mobile OS within 6 months
Given Apple's reported evaluation of PrismML's technology and the explicit mention of Bonsai 27B running on iPhones, it is plausible that Apple or another major mobile OS provider will announce an integration of this technology within the next six months. This would leverage the benefits of on-device AI for privacy and cost.
Apple's evaluation of PrismML's technology is a strong indicator of potential integration or acquisition.
Multiple clusters mention Apple's active exploration and discussions with PrismML regarding AI model shrinking and 1-bit architecture. The CEO's statement about Apple evaluating PrismML's technology, combined with reports of Apple exploring PrismML's 1-bit architecture for future iPhones, suggests a high likelihood of a deeper partnership, licensing deal, or even an acquisition.
PrismML's Bonsai 27B will see adoption by other mobile OS providers or hardware manufacturers within 90 days.
The breakthrough in running a 27B parameter model on an iPhone with minimal performance loss is a significant achievement. This technology has broad applicability beyond Apple's ecosystem. Other mobile OS providers (e.g., Google for Android) or chip manufacturers looking to enhance on-device AI capabilities could seek to license or adopt PrismML's optimization techniques.
-
Ternary LLMs see resurgence with new models from smaller labs
Recent developments suggest a resurgence in ternary (1.58-bit) large language models, with several new models released by smaller labs. These include prismML's 27B ternary model, Deepgrove's 20B Maple model, and Doses A…
-
PrismML tutorial details low-VRAM Bonsai-27B model deployment
PrismML has released a tutorial detailing the deployment of their Bonsai-27B model. This 1-bit quantized language model is designed to run on consumer GPUs, requiring only 5.2 GB of VRAM. The tutorial includes instructi…
-
Deploying 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Server
This tutorial details the deployment of the 1-bit Bonsai-27B language model using a specialized fork of llama.cpp that includes CUDA kernels for its unique quantization format. The process involves setting up the enviro…
-
27B AI model runs locally on Jetson Orin NX 16GB
A user successfully ran the Bonsai 27B language model locally on a Jetson Orin NX 16GB device, achieving usable performance for single-user applications despite the hardware's limitations. The setup involved a custom bu…
-
PrismML releases Bonsai 27B, a 27B LLM for offline mobile use
PrismML has released Bonsai 27B, a 27-billion-parameter large language model capable of running offline on mobile devices like the iPhone 17 Pro Max. The model achieves its small footprint through a novel 1-bit training…
-
AI model runs on iPhone, shrinking 27B parameters to under 4GB
PrismML, a startup spun out of Caltech, has developed Bonsai 27B, a 27.8-billion-parameter AI model capable of processing text and images that can run directly on an iPhone. This is achieved through an extreme form of q…
-
PrismML shrinks 27B LLM for local iPhone execution
PrismML has successfully compressed its Bonsai 27B large language model to a 3.9GB file size, enabling it to run locally on iPhones. This achievement maintains approximately 95% of the original model's performance, repr…
-
PrismML releases Bonsai 27B, first major AI model for iPhone
PrismML has announced the release of its Bonsai 27B AI model, which it claims is the first major model of its size capable of running on an iPhone. The company's CEO also indicated that Apple is evaluating PrismML's tec…
-
Bonsai-Ternary-27B model runs complex AI tasks locally on 16GB GPU
A user shared their experience running the Bonsai-Ternary-27B model locally on a 4060Ti 16GB GPU for knowledge base management and productivity tasks. The model successfully handled complex tasks, including querying, sy…
-
Apple Inc. eyes PrismML for larger on-device iPhone AI models
Apple Inc. is reportedly considering integrating PrismML's technology to enhance its on-device AI capabilities for iPhones. This move could enable the company to deploy larger AI models, such as a 27-billion-parameter m…
-
Apple in talks with PrismML to enable on-device AI for iPhone
Apple Inc. is reportedly in discussions with PrismML, a startup specializing in AI model compression. The goal of these talks is to enable sophisticated AI models to run directly on devices like the iPhone. This collabo…
-
Bonsai 27B model runs on phones; Google's Gemma 4 optimized for Pixel 10
PrismML has released Bonsai 27B, a 27-billion parameter model that can run on smartphones by utilizing 1-bit and ternary weights, reducing its size to under 6GB. This model supports complex tasks like multi-step reasoni…
-
PrismML releases Bonsai 27B, enabling Qwen3.6-27B on laptops and phones
PrismML has released Bonsai 27B, a highly compressed version of Qwen3.6-27B, available in 1-bit and ternary variants. These models are designed to run on consumer hardware like laptops and phones, with the 1-bit version…
-
PrismML compresses 27B AI model to fit on smartphones
PrismML has developed Bonsai 27B, a 27-billion-parameter multimodal AI model that has been compressed to approximately 3.9 GB, making it capable of running on mobile phones. This significant compression, achieved throug…
-
Apple in talks with PrismML to shrink AI models
Apple Inc. is reportedly in discussions with PrismML, a company specializing in AI model optimization. The potential collaboration aims to develop methods for shrinking large AI models, which could enable more efficient…
-
PrismML's Bonsai 27B model runs on iPhone, efficiency gains noted
PrismML has released Bonsai 27B, a 27-billion parameter AI model capable of running on a mobile device like the iPhone 17 Pro using only 3.9 GB of memory. A 1-bit variant of this model has been highlighted for its effic…
-
Bonsai 27B: 1-bit LLM runs in browser, shrinks to 3.8GB
The PrismML team has released Bonsai 27B, a 1-bit quantized large language model that can run locally in a web browser. This quantization technique reduces the model's size from 54GB to 3.8GB, while reportedly maintaini…
-
Startup shrinks 27B parameter AI model to run on iPhone
PrismML, a startup backed by Khosla, has developed a method to significantly compress large AI models, enabling them to run on mobile devices like the iPhone. Their compressed version of Alibaba's Qwen 3.6 model, with 2…
-
Apple explores 1-bit AI architecture for iPhone 17 Pro
Apple Inc. is reportedly exploring the integration of 1-bit architecture technology from PrismML. This potential integration could enable the iPhone 17 Pro to perform advanced AI tasks locally, significantly reducing en…
-
Apple explores PrismML tech for on-device AI on iPhones
Apple Inc. is reportedly in discussions with PrismML, a startup specializing in shrinking large AI models for on-device functionality. The goal is to enable iPhones to run more powerful AI models without relying on exte…