PulseAugur
EN
LIVE 19:10:53

Cursor open-sources MoK megakernel for faster MoE model training

By PulseAugur Editorial · [2 sources] ·

Cursor Research has open-sourced Mixture-of-Kittens (MoK), a specialized training kernel designed to optimize Mixture-of-Experts (MoE) models. This megakernel fuses communication and computation steps into a single deterministic process, reportedly achieving up to 2.37x higher throughput compared to existing baselines. MoK is designed for high-end hardware, specifically requiring NVIDIA Blackwell GB200 NVL72 or GB300 NVL72 racks, making it suitable for large-scale AI model development and cloud infrastructure providers. AI

IMPACT Enables faster training of large MoE models for organizations with high-end GPU infrastructure.

RANK_REASON Cursor Research open-sourced a specialized training kernel (MoK) for MoE models, which is a software tool rather than a new frontier model release.

Read on MarkTechPost →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Cursor open-sources MoK megakernel for faster MoE model training

COVERAGE [2]

  1. MarkTechPost TIER_1 English(EN) · Asif Razzaq ·

    Cursor Open-Sources Mixture-of-Kittens (MoK): A Deterministic MoE Training Megakernel for GB300 NVL72 Racks

    <p>Cursor Research has open-sourced Mixture-of-Kittens (MoK), the MoE training megakernel behind its Composer models. MoK fuses all mixture-of-experts communication and computation into a single deterministic kernel, and runs up to 2.37x faster than the strongest public baseline …

  2. r/LocalLLaMA TIER_1 English(EN) · /u/CapnHat ·

    Cursor releases their Mixture-of-Kittens megakernel for training MoE models - Claims to nearly double TFLOP/s

    <!-- SC_OFF --><div class="md"><p>Link: <a href="https://cursor.com/blog/mixture-of-kittens">https://cursor.com/blog/mixture-of-kittens</a></p> <p>GitHub: <a href="https://github.com/cursor/mixture-of-kittens">https://github.com/cursor/mixture-of-kittens</a></p> <p>Seems like a n…

RELATED ENTITIES

RELATED TOPICS