vllm-mlx
PulseAugur coverage of vllm-mlx — every cluster mentioning vllm-mlx across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
MTPLX and llama.cpp+MTP lead macOS benchmarks for Qwen3.8-27B
A user on Reddit's r/LocalLLaMA subreddit conducted extensive benchmarks to determine the fastest and most efficient engine for running the Qwen3.8-27B model on macOS. After five days and over 100 GPU hours of testing, …
-
Self-hosted Claude Code speedup achieved via caching and header stripping
A developer detailed how they significantly sped up their self-hosted Claude Code setup by addressing two key performance bottlenecks. The primary issue was a rotating billing header injected by Claude Code, which cause…
-
Claude code runs locally on MacBook, outperforming llama.cpp
A user successfully ran Anthropic's Claude code on their MacBook using the vllm-mlx library. This setup significantly outperformed llama.cpp, achieving an 87% improvement in performance. The author expressed surprise at…