UniPrefill

Inferix: A Block-Diffusion based Next-Generation Inference Engine for World Simulation

Researchers have developed UniPrefill, a novel framework designed to accelerate the prefill stage of long-context language models. Unlike previous methods that primarily benefit full-attention models, UniPrefill works a…