Moonshot AI has released Kimi K3, a new flagship model boasting 2.8 trillion parameters and a 1 million token context window. This open-source model represents a significant scaling achievement, demonstrating 2.5x efficiency over its predecessor, Kimi K2. The technical report details Kimi K3's innovative architecture, including Kimi Delta Attention (KDA) and Gated MLA with No Position Encoding (NoPE), which enable its impressive scale and long-context capabilities. AI
IMPACT Sets a new benchmark for open-source model scale and efficiency, potentially accelerating research and development in large context window models.
RANK_REASON Frontier-lab model release with technical report and open-source availability. [lever_c_demoted from frontier_release: ic=2 ai=1.0]
Read on X — Together (inference / OSS) →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →