The Maxwell Team has released Maxwell-V1-Flash, a new Mixture-of-Experts (MoE) language model. This model boasts 35 billion total parameters with 3 billion active parameters per token, and supports context lengths up to 256K tokens. Key features include Maxwell Block Sparse Attention for faster processing of long contexts, Manifold-Constrained Hyper-Connections for wider information flow, and a fine-grained MoE backbone. The model was pre-trained on approximately 26 trillion tokens of multilingual data and underwent a two-stage fine-tuning process for enhanced reasoning and agentic capabilities. AI
IMPACT This new MoE model offers strong reasoning and long-context capabilities, potentially impacting the development of more efficient and capable AI agents.
RANK_REASON Frontier-lab model release with system card [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →