PulseAugur
EN
LIVE 07:24:10

SCOPE framework enhances Diffusion Transformer efficiency for video attention

By PulseAugur Editorial · [2 sources] ·

Researchers have developed SCOPE, a novel training-free sparse attention framework designed to improve the efficiency of Diffusion Transformers (DiTs) in video processing. SCOPE addresses the quadratic cost of self-attention by employing subspace clustering and an online per-head Top-K estimation method. This approach allows for more adaptive and fine-grained selection of attention keys, outperforming existing methods in both fidelity and latency. In tests, SCOPE achieved up to a 1.99x speedup on the HunyuanVideo dataset. AI

IMPACT This framework could significantly reduce computational costs for video processing tasks using Diffusion Transformers.

RANK_REASON The cluster describes a new research paper detailing a novel technical framework for improving AI model efficiency.

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

SCOPE framework enhances Diffusion Transformer efficiency for video attention

COVERAGE [2]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention

    Diffusion Transformers (DiTs) incur quadratic self-attention cost over spatiotemporal tokens. Existing training-free sparse attention methods often construct sparse masks from block-level or cluster-level proxy scores, which can obscure fine-grained differences among keys and mis…

  2. arXiv cs.CV TIER_1 English(EN) · Qi Zhao, Qirui Li, Hanlin Tang, Yiduo Li, Zhen Guo, Cuifeng Shen, Chao Xu, Zhaosheng Chi, Xiaojin Lu, Kan Liu, Tao Lan, Lin Qu, Xi Li ·

    SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention

    arXiv:2608.12780v1 Announce Type: new Abstract: Diffusion Transformers (DiTs) incur quadratic self-attention cost over spatiotemporal tokens. Existing training-free sparse attention methods often construct sparse masks from block-level or cluster-level proxy scores, which can obs…

RELATED ENTITIES

RELATED TOPICS