ENTITY BitDecoding-FP4

BitDecoding-FP4

PulseAugur coverage of BitDecoding-FP4 — every cluster mentioning BitDecoding-FP4 across labs, papers, and developer communities, ranked by signal.

Total · 30d

1

1 over 90d

Releases · 30d

0

0 over 90d

Papers · 30d

1

1 over 90d

TIER MIX · 90D

TOPICS

SENTIMENT · 30D

1 day(s) with sentiment data

RECENT · PAGE 1/1 · 1 TOTAL

TOOL · CL_348594 · Nov 9 · 05:00

New BitDecoding-FP4 method boosts LLM serving throughput with FP4 KV cache

Researchers have developed BitDecoding-FP4, a novel algorithm-system co-design for efficient and accurate native FP4 KV cache decoding in large language models. This approach addresses accuracy drops and throughput degr…