Alibaba's MNN team has released MNN-Pocket-0.3B, a compact 173MB on-device language model designed for mobile applications. This model is capable of decoding approximately 350 tokens per second offline on devices like the iPhone 18 Pro. The release aims to facilitate the integration of AI capabilities directly into mobile apps. AI
IMPACT Enables more AI capabilities to run directly on mobile devices, improving performance and privacy.
RANK_REASON Release of an open-source model from a company's research team.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →