PulseAugur
EN
LIVE 04:28:16

Qwen3.5 122B model optimized for AMD ROCm with iMatrix

A new version of the Qwen3.5 model, specifically the 122B-A10B variant, has been released. This iteration is optimized for AMD's ROCm platform and utilizes an iMatrix quantization method, resulting in a 28.50 token/s decode speed. The model is 13.47 GB smaller and 36.89% faster in decoding compared to previous versions, with 10 billion active parameters. AI

IMPACT Offers improved performance and reduced size for AI models on AMD hardware.

RANK_REASON Release of a specific model variant with performance optimizations. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Qwen3.5 122B model optimized for AMD ROCm with iMatrix

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 Deutsch(DE) · /u/RedParaglider ·

    Qwen3.5 122B-A10B · ROCmFP4 iMatrix

    <table> <tr><td> <a href="https://www.reddit.com/r/LocalLLaMA/comments/1uxqgke/qwen35_122ba10b_rocmfp4_imatrix/"> <img alt="Qwen3.5 122B-A10B · ROCmFP4 iMatrix" src="https://external-preview.redd.it/ZsQ_oZPwDooHQBEezFxzVMx6hoV0k-R6aKCK1uBgaUk.png?width=640&amp;crop=smart&amp;auto…