Lightseekorg has achieved a new benchmark for the Qwen3.8-Flash-Next model, reaching 685 output tokens per second per user on NVIDIA GB300 GPUs with NVFP4. This result highlights the model's inference potential and the optimizations achieved in its kernel and serving infrastructure. Alibaba's Qwen team congratulated Lightseekorg on their impressive TokenSpeed results, encouraging further exploration of the model's capabilities. AI
IMPACT Demonstrates significant inference speed improvements for Qwen models, potentially impacting deployment costs and real-time application performance.
RANK_REASON Benchmark result for an existing model, not a new release. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →