FlashInfer
PulseAugur coverage of FlashInfer — every cluster mentioning FlashInfer across labs, papers, and developer communities, ranked by signal.
3 day(s) with sentiment data
-
New WAM-Diff2 framework boosts autonomous driving VLA model efficiency
Researchers have developed WAM-Diff2, a new framework designed to improve the efficiency of Vision-Language-Action (VLA) models for autonomous driving. This framework uses a hierarchical distillation strategy to convert…
-
LLMs advance GPU kernel generation and inference optimization · 4 sources tracked
Researchers are developing advanced methods for optimizing GPU kernel generation using large language models (LLMs). One approach, presented at MLSys 2026, uses a harness-centered system to constrain, validate, and prof…
-
DeepSeek V4 Flash with DSpark shows significant speed gains over EAGLE
A user on Reddit shared their experience deploying the DeepSeek V4 Flash model using DSpark via SGLang on an HGX-H200 system. They compared DSpark's performance against EAGLE, finding DSpark to be significantly faster, …
-
PersistentKV optimizes LLM serving on commodity GPUs with new scheduling techniques
A new paper introduces PersistentKV, a system designed to optimize the serving of large language models (LLMs) with long contexts on commodity GPUs. PersistentKV employs page-aware decode scheduling and a native block-t…
-
MiniMax M3 integrates with NVIDIA hardware, vLLM, and Inferact
SemiAnalysis reported on the successful integration of MiniMax AI's M3 model with NVIDIA's hardware, specifically highlighting the vLLM project and Inferact's EAGLE3 spec decode. This collaboration focuses on enabling d…
-
New framework speeds up LLM inference on NVIDIA H20 GPUs
Researchers have developed FlashMLA-ETAP, a new framework designed to significantly speed up the inference of large language models on NVIDIA H20 GPUs. The framework introduces an Efficient Transpose Attention Pipeline …
-
New Qrita Algorithm Boosts LLM Sampling Efficiency
Researchers have developed Qrita, a novel algorithm designed to enhance the efficiency of Top-k and Top-p sampling in large language models. By employing Gaussian-based sigma-truncation and a quaternary pivot search, Qr…
-
Fireworks AI flags numerical drift in LLM training vs. serving
Fireworks AI has identified critical numerical parity bugs that can arise when training and serving large language models, particularly Mixture-of-Experts (MoE) architectures. These discrepancies, stemming from the non-…