ENTITY
tokens per second
tokens per second
PulseAugur coverage of tokens per second — every cluster mentioning tokens per second across labs, papers, and developer communities, ranked by signal.
Total · 30d
0
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
0
0 over 90d
TIER MIX · 90D
TOPICS
RECENT · PAGE 1/1 · 2 TOTAL
-
LLM benchmarks mislead on inference speed for long contexts
Current LLM inference benchmarks are misleading because they primarily measure short-context performance, which does not reflect real-world usage involving longer contexts. This discrepancy arises from the differing com…
-
Tool visualizes LLM token generation speeds from 5 to 800 tokens/sec
A new interactive tool allows users to visualize the speed of language model token generation, from 5 to 800 tokens per second. Developed by Mike Veerman, this web application helps users understand advertised speeds li…