A Reddit user is seeking recommendations for large language models that can run on systems with 192GB of RAM, specifically mentioning their positive experience with Qwen3.5-397B. They have also made custom modifications to llama.cpp to improve performance for hybrid recurrent models and are looking to fix issues with tool calls and KV cache. The user is interested in other large models such as GLM 4.7 357B, Deepseek V4 Flash 284B, and Tencent Hy3 295B, and is asking the community about their experiences and comparisons. AI
IMPACT Provides insights into the practicalities and challenges of running very large language models locally, informing hardware choices and software optimization for advanced users.
RANK_REASON User-generated discussion about running large language models on consumer hardware, not a primary release or significant industry event.
- Claude
- Deepseek V4 Flash 284B
- GLM 4.7 357B
- Laguna M.1 225B
- llama.cpp
- Mimo 2.5 310B
- Minimax M2.7 229B
- Minimax M3 428B
- Qwen3.5-397B
- Qwen3.6-27B
- Tencent Hy3 295B
- Unsloth Dynamic UD-Q3_K_XL gguf
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
