Moonshot AI has released the weights for its Kimi K3.1 Pro model, which boasts 2.8 trillion parameters. This large model utilizes a sparse attention mechanism and a mixture-of-experts approach, allowing it to activate only 104 billion parameters for each inference task. This efficiency is key to managing the computational demands of such a massive AI. AI
IMPACT This release showcases advancements in efficient parameter utilization for extremely large models, potentially influencing future large-scale AI development.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →