Baidu has released ERNIE-5.5-Flash-Base, a large open-source Mixture-of-Experts (MoE) model with 280 billion total parameters and 14 billion active parameters per token. Pre-trained on 33.5 trillion tokens, the model supports a 1 million token context window for fine-tuning and inference. Baidu has released the raw pre-training checkpoint without further fine-tuning, allowing developers to adapt it for various applications. The model's architecture emphasizes efficiency, with specialized attention mechanisms and optimized MoE layers designed for reduced latency and memory usage, particularly on modern GPUs. AI
IMPACT Sets a new benchmark for efficient MoE architectures and long-context handling, potentially influencing future model development and deployment strategies.
RANK_REASON Frontier-lab model release with system card.
- A100 GPU
- Baidu
- ERNIE 5.5 Flash Base
- NVIDIA H100
- Artiverse
- ERNIE Team
- EU
- South Korea
- UK
- Unite.AI
- Docker Model Runner
- Google Colab
- Kaggle
- SGLang
- transformers
- vLLM
- DeepSeek-V4-Flash-Base
- Hugging Face
- mixture of experts
AI-generated summary · Google Gemini · from 8 sources. How we write summaries →