A new 35-billion parameter language model called POCKET-35B has been released, designed to run efficiently on consumer hardware, including PCs without dedicated GPUs and even smartphones. The model is available in various quantized versions, with file sizes ranging from 5.1 GB to 21 GB, allowing users to select the best fit for their device's RAM and performance needs. Notably, POCKET-35B can operate using standard llama.cpp software without requiring custom forks or cloud infrastructure. AI
IMPACT Enables local execution of a capable agentic model on consumer devices, reducing reliance on cloud infrastructure.
RANK_REASON Release of a specific model that runs on consumer hardware.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
