FlashMLA
PulseAugur coverage of FlashMLA — every cluster mentioning FlashMLA across labs, papers, and developer communities, ranked by signal.
- developed by DeepInfer: Open-Source Deep Learning Deployment Toolkit for Image-Guided Therapy 90%
- developed by ForgeKernel 90%
- used by DeepSeek-V4.1-Flash 70%
- used by DeepInfer: Open-Source Deep Learning Deployment Toolkit for Image-Guided Therapy 70%
- competes with ForgeKernel 70%
- developed DeepSeek-V4.1-Flash 50%
7 day(s) with sentiment data
-
AI agent autonomously optimizes NVIDIA GPU kernel, beats baseline by 9.8%
An AI agent named ForgeKernel has autonomously optimized NVIDIA's FlashMLA baseline for the B200 GPU, achieving a 9.8% performance increase in under 22 hours. The agent was able to improve the kernel's speed from 518 µs…
-
AI agent ForgeKernel writes faster code than human experts
An AI agent named ForgeKernel has autonomously generated optimized code for AI hardware, surpassing human-written benchmarks. In a 22.5-hour live demonstration, ForgeKernel wrote code that was 9.8% faster than DeepSeek'…
-
DeepSeek releases DeepInfer inference engine for optimized large-scale AI deployment
DeepSeek has open-sourced DeepInfer, a new inference engine designed to optimize large-scale model deployment. The engine incorporates advanced techniques such as a Zero-Overhead Batch Scheduler, asynchronous batching, …
-
AI-generated operators surpass human-tuned performance on benchmarks
DeepSeek has open-sourced its inference framework, DeepInfer, along with its FlashMLA operator library. This move aims to improve the performance of domestic large language models on hardware. Notably, an AI-generated o…
-
DeepInfer vs. vLLM: Benchmarking inference speed on B200 GPUs
A new open-source inference framework called DeepInfer, developed by DeepSeek, has been benchmarked against vLLM on eight NVIDIA B200 GPUs. The integration, facilitated by GPUStack and a lightweight serving project call…
-
DeepSeek releases open-source DeepInfer inference framework
DeepSeek has released DeepInfer, an open-source inference framework under the Apache 2.0 license. This framework is designed for large-scale inference and powers DeepSeek's production services, with the open-source vers…
-
vLLM v0.31.0 enhances serving with FlashMLA, DeepGEMM, and MXFP8
vLLM has released version 0.31.0, bringing significant enhancements to its serving capabilities. This update integrates FlashMLA with V4.1 NVFP4 compressed KV cache as the default for SM100, alongside the inclusion of D…
-
DeepSeek, Huawei Open-Source Tools to Challenge Nvidia's AI Dominance · 10 sources tracked
DeepSeek and Huawei have jointly released a suite of open-source tools designed to enhance the software ecosystem for Huawei's Ascend AI chips. This initiative aims to provide a viable alternative to Nvidia's dominant C…
-
New framework speeds up LLM inference on NVIDIA H20 GPUs
Researchers have developed FlashMLA-ETAP, a new framework designed to significantly speed up the inference of large language models on NVIDIA H20 GPUs. The framework introduces an Efficient Transpose Attention Pipeline …