ENTITY
IQ models
IQ models
PulseAugur coverage of IQ models — every cluster mentioning IQ models across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
llama.cpp adds AVX2 support for faster prompt processing
A pull request to the llama.cpp project introduces AVX2 instruction set support to accelerate prompt processing for IQ models, particularly with large batch sizes. This optimization aims to improve the speed of local la…
-
llama.cpp PR boosts IQ model prompt processing with AVX2 optimizations · 1 source tracked
A pull request for the llama.cpp project introduces AVX2 optimizations to significantly accelerate prompt processing for IQ models, particularly at large batch sizes. Benchmarks show dramatic speed increases, with some …