VIDRAFT has released POCKET-35B-GGUF, a 35-billion-parameter large language model designed for CPU-only inference. This model is quantized and packaged in the GGUF format, making it accessible for local deployment on standard hardware without requiring a GPU. The development aims to enable privacy-preserving LLM usage for individuals and organizations that cannot or prefer not to use cloud-based GPU infrastructure. AI
IMPACT Enables wider adoption of powerful LLMs on consumer hardware, prioritizing privacy and reducing reliance on cloud GPUs.
RANK_REASON Release of a large language model optimized for CPU-only inference, making advanced AI capabilities more accessible on standard hardware.
- central processing unit
- GGML
- GGUF
- graphics processing unit
- llama.cpp
- Mindverse
- POCKET-35B-GGUF
- VIDRAFT
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →