ENTITY
chunked prefill
chunked prefill
PulseAugur coverage of chunked prefill — every cluster mentioning chunked prefill across labs, papers, and developer communities, ranked by signal.
Total · 30d
2
2 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
1
1 over 90d
TIER MIX · 90D
TOPICS
SENTIMENT · 30D
1 day(s) with sentiment data
RECENT · PAGE 1/1 · 2 TOTAL
-
LLM serving splits into two phases to double GPU throughput
Modern LLM serving architectures are evolving to handle requests more efficiently by splitting the process into two distinct phases: prefill and decode. The prefill phase, which processes the entire prompt, is compute-b…
-
vLLM configurations impact LLM energy, performance, and accuracy
A new research paper investigates the trade-offs between energy consumption, performance, and accuracy when configuring inference engines like vLLM for large language models (LLMs). The study analyzed combinations of at…