PulseAugur
EN
LIVE 17:52:54

Qwen 3.5 35B model runs at 18 tokens/sec on Radeon 7600 GPU

A user on Reddit's r/LocalLLaMA subreddit shared their experience running the Qwen 3.5 35B model on a Radeon 7600 GPU. They achieved a speed of 18 tokens per second using specific settings with llama.cpp on an Ubuntu system, highlighting the model's performance on consumer-grade hardware. AI

IMPACT Demonstrates the capability of running large language models on more accessible hardware, potentially lowering the barrier to entry for local AI experimentation.

RANK_REASON User-level report on running a specific model variant on consumer hardware.

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Qwen 3.5 35B model runs at 18 tokens/sec on Radeon 7600 GPU

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/Sweaty_Perception655 ·

    Running Qwen 3.5 35B A3B-Q8_0 gguf on a cheap radeon 7600 at 18 token/s

    <!-- SC_OFF --><div class="md"><p>I also have 64 gb ddr4 ryzen 5600 Using llama.cpp Ubuntu distro</p> <p>Settings are as follows</p> <p>--n-gpu-layers 999 \</p> <p>--n-cpu-moe 37 \</p> <p>--no-mmap \</p> <p>-ctk q8_0 \</p> <p>-ctv q8_0 \</p> <p>-fa 1 \</p> <p>-c 9000 \</p> </div>…