Microsoft has unveiled MAI-Base-2, a new Mixture-of-Experts (MoE) model boasting 2 trillion parameters, with 80 billion active. This model was trained for 38 days using 16,000 GB200 units on 50 trillion tokens. Internally, MAI-Base-2 reportedly outperforms DeepSeek-V4-Pro-Base by up to 12 times in hardware efficiency, largely due to its 100% MoE architecture. However, the model's weights are licensed only to trusted partners via Azure, indicating a closed approach despite its efficiency gains. AI
IMPACT Sets a new benchmark for MoE architecture efficiency and scale, potentially influencing future large model development.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=2 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →