The veloGB10, a new Rust/CUDA engine, has been tested with Qwen3.8-Flash-Next on DGX Spark hardware. This engine natively loads EXL3 weights and uses speculative decoding via MTP-Heads. Initial performance metrics show significantly improved decoding numbers compared to previous stacks on the Ascent GX10. AI
IMPACT This development could lead to more efficient AI model inference through specialized hardware engines.
RANK_REASON The item describes a new engine and its performance with a specific model, which falls under research and development in AI infrastructure. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →