PulseAugur
EN
LIVE 02:30:01

Huawei open-sources openPangu-2.0-Pro MoE model with 505B parameters

By PulseAugur Editorial · [1 sources] ·

Huawei has open-sourced its new Mixture-of-Experts (MoE) model, openPangu-2.0-Pro. This model boasts a total of 505 billion parameters with 18 billion activated, and supports a context length of 512,000 tokens. It was trained on 34 trillion tokens and incorporates advanced training techniques including unified SFT for slow and fast thinking, multiple specialist RL training, and on-policy distillation. AI

IMPACT This open-source release provides researchers and developers with a powerful new MoE model, potentially accelerating advancements in efficient large language model development and deployment.

RANK_REASON Open-source release of a large language model from a major tech company. [lever_c_demoted from research: ic=1 ai=1.0]

Read on r/LocalLLaMA →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Huawei open-sources openPangu-2.0-Pro MoE model with 505B parameters

How we ranked this

Signal score
0 / 100
Composite score across the factors below. Higher = stronger signal that this story matters right now.
Newsworthiness bucket
Tool
Open-source release of a large language model from a major tech company. [lever_c_demoted from research: ic=1 ai=1.0]
Source corroboration
Single-source cluster
Only one publisher covered this so far. Single-source stories can still rank when the publisher is high-authority, but they lack cross-source corroboration.
Topics
model release, product
Editorial topic classification. Feeds into how the story surfaces on /topic/<slug> hub pages and into the per-entity coverage mix.
AI-industry relevance
High
Clearly on-topic for AI-industry coverage.
Story freshness
53 days old
Aged out of breaking-news scoring windows; ranking reflects the durable signal from the full source set.

Full methodology in our editorial standards.

COVERAGE [1]

  1. r/LocalLLaMA TIER_1 English(EN) · /u/langsfang ·

    Huawei opensouced openPangu-2.0-Pro, 505B-A18B

    <!-- SC_OFF --><div class="md"><p>openPangu-2.0-Pro is an MoE model trained on Ascend. The model has 505B total parameters and 18B activated parameters. Its context length is 512k. The total pretraining data contains 34T tokens. During Post-training, openPangu-2.0-Pro is trained …

RELATED ENTITIES

RELATED TOPICS