A Reddit user on the r/LocalLLaMA subreddit is seeking recommendations for the best local large language models (LLMs) that can run effectively on a system with 8 GB of VRAM, specifically for coding and agentic coding tasks. The user shares their current setup, which includes an RTX 3070 Laptop GPU with 8 GB VRAM, and their preferred model, Qwen3.6-35B-A3B-UD-IQ4_NL by Unsloth, which achieves approximately 25 tokens/s for agentic coding. They are prioritizing a balance of speed, coding ability, tool use, reliability, and the quality of the final output over raw benchmark scores, and are asking the community for their real-world experiences and model suggestions. AI
IMPACT Provides insights into optimizing LLM performance on consumer-grade hardware for coding tasks.
RANK_REASON User-generated discussion and request for recommendations on running LLMs with limited hardware.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
