MiniMax Sparse Attention
PulseAugur coverage of MiniMax Sparse Attention — every cluster mentioning MiniMax Sparse Attention across labs, papers, and developer communities, ranked by signal.
- 2026-07-25 research_milestone Fireworks AI achieved a 1.6x throughput uplift on MiniMax Sparse Attention through kernel optimizations. source
2 day(s) with sentiment data
-
Fireworks AI boosts MiniMax Sparse Attention throughput by 1.6x
Fireworks AI has optimized the MiniMax Sparse Attention (MSA) kernel, resulting in a 1.6x throughput increase. This enhancement focuses on refining the load and store pipelines within the attention kernel. The improveme…
-
MiniMax M3: Open-weight 1M-context model released, but commercial use restricted
MiniMax has released MiniMax M3, an open-weight Mixture-of-Experts model featuring a 1 million token context window and native multimodality. The model boasts 428 billion total parameters, with only 23 billion active pe…
-
New research explores hybrid and sparse attention mechanisms for LLMs
Researchers are exploring novel methods to optimize attention mechanisms in large language models, particularly for handling long contexts. The HydraHead architecture, for instance, hybridizes Full Attention (FA) and Li…
-
Together AI offers MiniMax M3 multimodal model with 1M context
Together AI has announced the availability of the MiniMax M3 API, an open-weight, native multimodal model. This model boasts a 1 million token context window, enhanced by MiniMax Sparse Attention, and features distinct …
-
MiniMax AI releases open-weight multimodal M3 model
MiniMax AI has released its MiniMax M3 model, featuring open weights and approximately 428 billion total parameters with 23 billion active parameters. This model is designed for the agent era and supports native multimo…
-
MiniMax AI highlights M3 model's Sparse Attention mechanism
MiniMax AI recently held a live session discussing their M3 model, highlighting the MiniMax Sparse Attention (MSA) mechanism. Unlike other attention methods that compress the KV cache, MSA preserves the uncompressed KV …