StepFun has released a preview of its Step-5-Preview-NVFP4 model, a 600 billion parameter Mixture-of-Experts (MoE) architecture with 27 billion active parameters. This new model supports a 1 million token context window and can process text, image, and video inputs. The release also introduces NVFP4 quantization, designed to enhance inference performance on NVIDIA hardware. AI
IMPACT This release offers a large context window and MoE architecture, potentially improving efficiency and capability for complex tasks.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →