A user tested four CMP170HX graphics cards, each configured with 64GB of memory, totaling 256GB of VRAM. The tests focused on running various large language models, with results indicating that smaller models can fit entirely on a single card or run concurrently if their combined VRAM usage stays within the 64GB limit. The performance is comparable to NVIDIA's 30xx series, with potential for higher throughput if using cards with more memory. The user also noted that the PCIe Gen2 x4 interface did not significantly bottleneck performance, even when loading large models, suggesting a potential for scaling up to 16 cards in a single PC. AI
IMPACT Provides insights into the viability of using older or repurposed hardware for running large language models locally.
RANK_REASON User benchmark of consumer-grade hardware for LLM deployment.
- CMP170HX
- gemma-4-31B
- GLM-4.5-Air
- gpt-oss-120B
- gpt-oss-20B
- Laguna-S 2.1
- llama.cpp
- Qwen
- Qwen3.6-27B
- Qwen3.6-35B-A3B
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
