Learning to Solve Generative ODEs Beyond the Linear Span
Researchers have developed SpanLift, a new neural solver designed to improve the efficiency of generative models. Current models integrate learned Ordinary Differential Equations (ODEs), but this process is slow due to the need for many sequential evaluations. SpanLift addresses this by augmenting standard updates with a spatial residual operator, allowing it to capture components beyond the linear span of buffered velocity evaluations. This method has demonstrated state-of-the-art few-step sampling across various applications, significantly improving metrics like FID scores on datasets such as CIFAR-10 and ImageNet with minimal model evaluations. AI
IMPACT Improves sampling efficiency for generative models, potentially reducing computational costs and enabling faster generation of high-quality outputs.