A user on the r/LocalLLaMA subreddit is seeking recommendations for large language models (LLMs) with over 40 billion parameters. They are currently using Qwen3.6 35B but find it lacks general knowledge and acts more as an executor than an assistant. The user is considering upgrading to Qwen3.5 122B but is concerned about maintaining speed, as they currently achieve around 30-40 tokens/second with a 131k context window on their Strix Halo hardware. AI
IMPACT User discussion highlights the trade-offs between model size, general knowledge, and inference speed for local LLM deployments.
RANK_REASON User discussion on model selection and performance.
- Command R+
- Falcon 180B
- Grok-1
- llama
- Llama 3
- mistral.ai
- Mixtral 8x7B
- Qwen1.5-72B
- Qwen3.5 122B
- Qwen3.6 35B
- Strix Halo
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
