Cohere has quietly released North Small Translate, a 218-billion-parameter Mixture-of-Experts (MoE) model specifically designed for machine translation. This sparse model, with 25 billion active parameters per token, supports 50 languages and sets a new benchmark for translation quality, achieving a WMT26 score of 83.60. The model's weights are available on Hugging Face for research and non-commercial use, while production deployments are handled through Cohere's Model Vault. The release signifies a trend towards massive, specialized models that are more efficient due to sparsity, making them potentially more accessible for self-hosting on high-end hardware like NVIDIA B200 or H100 GPUs. AI
IMPACT Sets a new benchmark for translation quality and signals a trend towards massive, specialized models accessible for self-hosting.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
- bfloat16
- Cohere
- Creative Commons Attribution-NonCommercial 4.0 International
- Hugging Face
- mixture of experts
- Model Vault
- North Small Translate
- Nvidia B200
- NVIDIA H100
- Python
- WMT26
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →