A user on Reddit shared performance benchmarks for the Qwen3.8-Flash-Next Gyro S model running on a Valve Steam Machine with an 8 GB AMD GPU and 32 GB of RAM. The setup achieved approximately 18 tokens per second for decoding and 235 tokens per second for prefill, utilizing the stock SteamOS. Key to the performance was the `--set resident-budget-gib=64` parameter, which improved decode speed by about 20% by keeping model experts in RAM rather than the OS page cache. Other tested configurations, such as PCIe fraction adjustments and larger VRAM reserves, showed no measurable impact on performance. AI
IMPACT Demonstrates performance of a specific LLM on consumer-grade hardware, offering insights for local deployment.
RANK_REASON User-generated benchmark of a specific model on consumer hardware.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →