llama-bench
PulseAugur coverage of llama-bench — every cluster mentioning llama-bench across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
MoE models tested for local coding on older GPU
This article evaluates Mixture-of-Experts (MoE) models for local coding tasks on a GTX 1080 Ti GPU. The author tested several MoE models, including Qwen3.8-Flash-Next and Qwen3.8-35B-A3B-Q4_K_M, assessing their perplexi…
-
AI benchmarking tools: Custom builds vs. existing solutions explored
The author of a blog focused on AI hardware and model performance investigated whether their custom-built benchmarking tools were necessary or if existing solutions could have been utilized. They found that while hardwa…
-
llama-bench defaults corrected for flash attention and GPU layers
A recent build, b9437, for the llama-bench tool has corrected default settings related to flash attention and GPU layer counts. Previously, the tool hard-coded flash attention off, even on compatible hardware, and used …
-
User benchmarks Qwen3 models on R9700 hardware
A user conducted performance tests on various hardware configurations using Qwen3 models, specifically Qwen3-8B, Qwen3-14B, and Qwen3-32B. The tests utilized llama-bench and a custom benchmark setup, with results detail…
-
LocalLLaMA users seek MTP integration for llama-bench
Users on the r/LocalLLaMA subreddit are seeking a solution to integrate llama-bench with MTP, as standard methods that work with llama-server are failing. The core issue appears to be compatibility, with speculation tha…