Fang Sun

New methods accelerate LLM inference with speculative decoding · 7 sources tracked

Researchers are developing new methods to accelerate the inference speed of large language models (LLMs) through speculative decoding. DARTree and SPADE are two such approaches, with DARTree focusing on tree-based specu…