Mixture of Kittens
PulseAugur coverage of Mixture of Kittens — every cluster mentioning Mixture of Kittens across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
Cursor's MoK redefines MoE execution, optimizing GPU kernel for faster AI training
Cursor has developed and open-sourced Mixture-of-Kittens (MoK), a new software layer designed to optimize the execution of Mixture-of-Experts (MoE) models. MoK addresses inefficiencies in token scheduling, inter-GPU com…
-
Megakernels: Outdated research or performance breakthrough?
The discussion around "megakernels" in AI inference has shifted, with many now considering them outdated for production environments. While theoretically appealing for reducing launch overhead, the complexity of optimiz…
-
Cursor releases open-source MoE training megakernel, Mixture-of-Kittens
Cursor Research has open-sourced Mixture-of-Kittens (MoK), a specialized training kernel designed for Mixture-of-Experts (MoE) models. This megakernel fuses MoE communication and computation into a single deterministic …
-
Cursor open-sources Mixture-of-Kittens training megakernel · 3 sources tracked
Cursor has open-sourced Mixture-of-Kittens (MoK), an MoE training megakernel designed for NVL72s. This kernel fuses communication and computation for Mixture-of-Experts models, achieving up to 2.37x faster performance t…