PrismML, a startup backed by Khosla, has developed a method to significantly compress large AI models, enabling them to run on mobile devices like the iPhone. Their compressed version of Alibaba's Qwen 3.6 model, with 27 billion parameters, is now small enough (under 4GB) to operate on an iPhone 17 Pro, performing complex tasks such as chat, reasoning, and coding. This breakthrough, stemming from research at Caltech, aims to shift AI processing from the cloud to local devices, fundamentally altering AI economics. AI
IMPACT Accelerates the trend of on-device AI processing, potentially reducing reliance on cloud infrastructure for many AI tasks.
RANK_REASON Startup claims breakthrough in shrinking large AI models to run on mobile devices. [lever_c_demoted from significant: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
