A user on Reddit shared details of a custom-built AI server designed for running large language models locally. The machine, costing approximately $10,733.91 per unit, features four ASRock Radeon AI PRO R9700 Creator GPUs, providing a total of 128 GB of VRAM per card and 384 GB across three machines. These systems are utilized to power the AI for a firearms-related business, handling tasks such as fact-checking, business identification, and data extraction, with the Qwen/Qwen3.8-27B-FP8 model chosen for its cost-to-performance ratio. AI
IMPACT Enables cost-effective local deployment of LLMs for specialized business applications.
RANK_REASON User-built hardware for running AI models locally.
- AMD EPYC 7452
- ARCTIC Freezer 4U-M
- ARCTIC P12 Pro
- ASRock Rack ROMED8-2T/BCM
- ASRock Radeon AI PRO R9700 Creator
- DDR4-2666 ECC RDIMM
- EPYCs
- Noctua NF-A8
- Qwen
- Qwen/Qwen3.8-27B-FP8
- R9700
- Samsung 990 PRO 1 TB
- SilverStone HELA 2050R Platinum
- SilverStone RM44 4U
- USA Arms
- vLLM-Radiance
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →