PulseAugur
EN
LIVE 21:42:25

China's LongCat-2.0 trained without NVIDIA using efficient MoE design

Meituan has developed LongCat-2.0, a 1.6 trillion parameter language model trained entirely on domestic Chinese AI chips, avoiding NVIDIA hardware. The model's efficiency stems from its Mixture-of-Experts architecture, which utilizes only 3% of its parameters per token. This design significantly reduces the per-step workload and network traffic, enabling training on less powerful, non-NVIDIA accelerators. AI

IMPACT Demonstrates feasibility of training large models without top-tier accelerators by optimizing parameter utilization.

RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]

Read on Towards AI →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

China's LongCat-2.0 trained without NVIDIA using efficient MoE design

COVERAGE [1]

  1. Towards AI TIER_1 English(EN) · Kashif Mehmood ·

    China’s LongCat-2.0 is a 1.6T Model Trained Without NVIDIA

    <div class="medium-feed-item"><p class="medium-feed-image"><a href="https://pub.towardsai.net/chinas-longcat-2-0-is-a-1-6t-model-trained-without-nvidia-705ecac7c994?source=rss----98111c9905da---4"><img src="https://cdn-images-1.medium.com/max/1408/1*TLbOathkgjJ94_J4k4XZxQ.png" wi…