SGLang
PulseAugur coverage of SGLang — every cluster mentioning SGLang across labs, papers, and developer communities, ranked by signal.
- 2026-07-25 product_launch SGLang released version 0.5.16, including the new DSpark speculative decoding algorithm. source
- 2026-07-23 controversy A critical vulnerability, CVE-2026-14890, was disclosed in SGLang, enabling unauthenticated remote code execution. source
- 2026-06-20 product_launch SGLang and MUSA merge backends, enabling native GPU support for China's open-source AI ecosystem. source
- 2026-01-09 product_launch SGLang released version 0.3.1 of its model gateway, featuring performance and memory improvements. source
28 day(s) with sentiment data
-
AI inference costs can be reduced through systematic optimization, Meryem Arik explains
Meryem Arik presented a talk on reducing AI inference costs, emphasizing systematic optimization across various workloads. The discussion covered strategies for data transformation, offline agents, and aggregated insigh…
-
MiniMax H3 model sees major speed boost with Sol Engine
MiniMax AI has announced significant speed improvements for its MiniMax H3 model using the Sol Engine. This agent-native Sol Video Inference Engine achieved a 3.95x speedup compared to Diffusers and a 2.80x speedup over…
-
Unsloth releases Muse-Glimmer-30B-GGUF multimodal model
Unsloth has released Muse-Glimmer-30B-GGUF, a multimodal model capable of processing both text and images. The model is available on Hugging Face and is designed for efficient use with various libraries and inference pr…
-
Developer runs 122B Qwen LLM locally on AMD MI300X GPU
A developer has successfully deployed the Qwen3.5-122B large language model locally on AMD MI300X GPU infrastructure. This setup utilizes vLLM and SGLang for inference, enabling an autonomous agent built with OpenClaw. …
-
Moore Threads reports 147% revenue growth, surpassing 2025 full-year figures
Moore Threads, a leading domestic GPU manufacturer, reported strong financial results for the first half of 2026, with revenue reaching 1.736 billion yuan, a 147.42% year-over-year increase. This figure already surpasse…
-
Pokee AI launches 28B model with 10M-token context for on-premise use
Pokee AI has released Pokee-Isaac 28B, a 28 billion parameter text-only foundation model designed for deployment within private customer boundaries. This model boasts a 10 million token context window, enabling it to ma…
-
SGLang benchmarks show 5x faster agent TTFT over vLLM
SGLang and vLLM are compared for enterprise LLM inference, with SGLang's RadixAttention showing a 5x faster time-to-first-byte for agents. The benchmark also highlighted potential pitfalls such as VRAM out-of-memory err…
-
DeepSeek V4 Flash officially released, claims benchmark wins
DeepSeek has officially released its V4 Flash model, which the company claims outperforms its V4 Pro preview version across nine agentic benchmarks. The article verifies these claims by examining the model card and conf…
-
New GRIT format aims to prevent silent bugs in quantized AI models
A new interchange format called GRIT (Grouped Reduced-precision Interchange Type) has been developed to address critical bugs in quantized model checkpoints. These bugs, which occurred silently in systems like vLLM and …
-
Kimi-VL model scaled using heterogeneous E/PD on llm-d and SGLang
This item details the technical advancements in scaling the Kimi-VL model, which is designed for vision-heavy tasks. The scaling was achieved through heterogeneous E/PD (Execution/Processing Distribution) methods implem…
-
Bad Theory Labs releases BTL-4, a 35B agentic reasoning model
Bad Theory Labs has released BTL-4, a 35 billion parameter agentic reasoning model fine-tuned from Ornith-1.0-35B. This model is specifically designed for tool use, software engineering tasks, and long-horizon agent wor…
-
New 5.72B MoE model fuses coding experts from Qwen3.6-35B-A3B
The Akahsizrr/fuse-1-Lite model is a 5.72B parameter Mixture-of-Experts model that combines a lightweight language model with coding experts from Qwen3.6-35B-A3B. This fusion approach involves transplanting expert weigh…
-
Liquid AI releases on-device agentic model LFM2.5-2.6B with 128K context
Liquid AI has released LFM2.5-2.6B, an open-weights, on-device agentic model designed for mobile and edge devices. This model boasts 2.69 billion parameters, a 128,000-token context window, and can perform multi-step ta…
-
DeepGrove releases Maple-Preview, a 20B-A1B reasoning LLM
DeepGrove has released Maple-Preview, an open-source 20B-A1B ternary-weight LLM focused on reasoning capabilities. The model demonstrates state-of-the-art performance for its weight class, even competing with larger mod…
-
DSv4-Flash optimization boosts LLM inference speed on NVIDIA GH200
A new optimization technique called DSv4-Flash has been developed to significantly speed up large language model inference on NVIDIA GH200 hardware. This optimization, when implemented with vLLM and SGLang, can achieve …
-
Mingxin FX100 boosts LLM inference with KV Cache reuse · 2 sources tracked
Mingxin FX100 has demonstrated significant performance improvements in multi-turn dialogue scenarios for large language models. By implementing KV Cache reuse strategies, which involve caching key-value tensors from pre…
-
Bole system accelerates hybrid-attention LLM inference with tree speculation
Researchers have developed Bole, a new system designed to accelerate inference for hybrid-attention large language models. These models combine full attention with recurrent linear attention to manage long contexts more…
-
New research boosts LLM speculative decoding speed and efficiency · 4 sources tracked
Four new research papers published on arXiv introduce novel techniques to enhance speculative decoding for large language models. These methods aim to improve generation speed and efficiency without requiring additional…
-
FP8 KV Cache Quantization Doubles Context Length for LLMs
Researchers have developed a method using FP8 KV cache quantization to improve the efficiency of large language models like Kimi and GLM. This technique effectively doubles the context length with minimal performance ov…
-
User seeks DSpark configuration help for dual RTX 6000 GPUs
A user on Reddit is seeking assistance with configuring DSpark on a system equipped with dual RTX 6000 graphics cards. They have encountered issues using DSpark with both SGLang and vLLM, and have had limited success wi…