Allen Institute for Artificial Intelligence (AI2) has released Olmo-core 3, an open infrastructure designed for large-scale Mixture of Experts (MoE) model training. This new system enhances throughput by keeping experts resident on GPUs, achieving over 52,000 tokens per GPU per second for a 47B parameter model, a 2.7x improvement over previous implementations. Olmo-core 3 also demonstrated a 21% increase in training throughput with MXFP8, while reducing memory usage. This infrastructure is intended as the foundation for future Olmo models and is available for researchers. AI
IMPACT Enhances efficiency and accessibility for training large AI models, potentially accelerating research and development in MoE architectures.
RANK_REASON Release of new open-source infrastructure for large-scale AI model training by a prominent research institute.
Read on Mastodon — fosstodon.org →
- Allen Institute for Artificial Intelligence
- ChatGPT
- Claude
- Genex
- MIT License
- Nvidia
- Olmo-core 3
- Three.js
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →