A user has successfully configured the DeepSeek-V4-Flash-0731 model to run on four Radeon AI PRO R9700 graphics cards, achieving approximately 79 tokens per second. This configuration overcomes a previous limitation where the affinity engine would not start with more than two cards, a problem that appears to stem from simulation rather than actual hardware execution. The setup involves specific affinity engine forks and placement strategies to ensure all model experts reside in VRAM, eliminating the need for a host pool and improving performance. AI
IMPACT Demonstrates improved performance and broader hardware compatibility for large language models.
RANK_REASON User successfully configured and benchmarked a specific model on consumer hardware, overcoming a software limitation.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →