A 1.5 billion parameter language model named VibeVoice has been successfully run locally on an iPhone, utilizing approximately 2.2 GB of memory. The model achieved generation speeds up to 1.28 times faster than real-time. This development is part of an effort to integrate the model into the audio.cpp framework, with plans to release the code and an xcframework after the 0.6 release. AI
IMPACT Enables running advanced language models on mobile devices, potentially expanding accessibility and use cases.
RANK_REASON Demonstration of a specific model running on a consumer device.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
