decoding constraints

LLM speed benchmarks criticized for misleading real-world performance

A recent analysis argues that common LLM speed benchmarks are misleading because they fail to account for crucial factors like payload size, output format, and decoding constraints. These benchmarks often present a sing…