PulseAugur
EN
LIVE 17:07:25

Alibaba's Qwen3.8-27B model achieves 206 tok/s on RTX 5090

Alibaba's Qwen team has released Qwen3.8-27B, an open-source small model that achieves impressive performance metrics. The model can decode at 206.1 tokens per second on a single RTX 5090 GPU, utilizing NVFP4 and DSpark optimizations. This release also includes Day-0 support in SGLang, a project that facilitates efficient model execution. AI

IMPACT Sets a new benchmark for small model performance on consumer GPUs, potentially lowering barriers to entry for advanced AI applications.

RANK_REASON Frontier-lab model release with performance metrics. [lever_c_demoted from frontier_release: ic=1 ai=1.0]

Read on X — Qwen (Alibaba) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Alibaba's Qwen3.8-27B model achieves 206 tok/s on RTX 5090

COVERAGE [1]

  1. X — Qwen (Alibaba) TIER_1 English(EN) · Alibaba_Qwen ·

    Yes, we are back👑, with 206 tok/s on a single RTX 5090!

    Yes, we are back👑, with 206 tok/s on a single RTX 5090! Amazing Day-0 work from the SGLang team. Give it a try~@sgl_project