Qwen 3.6 27B model performance drops with speculative decoding params

A user on the r/LocalLLaMA subreddit is experiencing a significant drop in inference speed and GPU utilization when using the Qwen 3.6 27B model with specific parameters related to speculative decoding. When parameters like `--spec-type draft-mtp` and `--spec-draft-n-max` are included, their throughput plummets from 70 tokens/second to 30 tokens/second, and GPU power draw decreases substantially. The user suspects a recent update to llama.cpp might be the cause, as the performance was previously much higher. AI

IMPACT Potential performance regressions in open-source LLM inference engines can impact local deployment efficiency.

RANK_REASON User-reported performance issue with an open-source model and inference engine. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

• llama.cpp
• Qwen 3.6 27B

• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →