DiffuSpec

DFlash accelerates AI inference with parallel token block drafting · 2 sources tracked

Researchers from the University of California, San Diego, have developed DFlash, a novel speculative decoding technique that significantly accelerates AI inference. Unlike traditional methods that generate tokens one by…