Kimi K2.x

New MLA attention mechanism slashes LLM KV cache by up to 10x

Multi-Head Latent Attention (MLA) is a novel attention mechanism designed to significantly compress the KV cache in large language models. By projecting KV pairs into a low-dimensional latent space, MLA achieves substan…