PulseAugur
实时 09:04:55

New AI models tackle image and video restoration with advanced techniques

Researchers have developed several new methods for image and video restoration tasks. One approach, Continuous Expert Assembly (CEA), uses a dynamic parameterization framework to adapt to diverse local degradation patterns in images. Another method integrates segmentation models like SAM2 to derive region-distinguishable priors for more accurate video frame interpolation. Additionally, a benchmark has been created for evaluating multi-frame image restoration under severe refractive warping, and a hybrid Transformer-State-Space Model framework aims to improve restoration efficiency on edge hardware. AI

影响 Advances in image and video restoration techniques could improve visual quality in various applications, from media to surveillance.

排序理由 Multiple research papers published on arXiv detailing new methods and benchmarks for image and video restoration.

在 arXiv cs.CV 阅读 →

AI 生成摘要 · Google Gemini · 来自 9 个来源。 我们如何撰写摘要 →

New AI models tackle image and video restoration with advanced techniques

报道来源 [9]

  1. arXiv cs.CV TIER_1 English(EN) · Yan Han, Xiaogang Xu, Yingqi Lin, Jiafei Wu, Zhe Liu, Ming-Hsuan Yang ·

    Restoration-Oriented Video Frame Interpolation with Region-Distinguishable Priors from SAM

    arXiv:2312.15868v3 Announce Type: replace Abstract: In existing restoration-oriented Video Frame Interpolation (VFI) approaches, the motion estimation between neighboring frames plays a crucial role. However, the estimation accuracy in existing methods remains a challenge, primar…

  2. arXiv cs.CV TIER_1 English(EN) · Haisen He, Xiangyu Zou, SongLin Dong, Heng Li, Yihong Gong, Zhiheng Ma ·

    Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration

    arXiv:2605.06127v1 Announce Type: new Abstract: Real-world image degradation is often unknown, spatially non-uniform, and compositional, requiring all-in-one restoration models to adapt a single set of weights to diverse local corruption patterns without test-time degradation lab…

  3. arXiv cs.CV TIER_1 English(EN) · Zhiheng Ma ·

    Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration

    Real-world image degradation is often unknown, spatially non-uniform, and compositional, requiring all-in-one restoration models to adapt a single set of weights to diverse local corruption patterns without test-time degradation labels. Existing methods typically modulate a share…

  4. arXiv cs.CV TIER_1 English(EN) · Maxim V. Shugaev, Md Reshad Ul Hoque, Bridget Kennedy, Joseph T. Riley, Fiona Hwang, Justin Hagen, Harvir Ghuman, Ethan Garcia-O'Donnell, Syed Noor Qadri, Freddie Santiago, Mun Wai Lee ·

    A unified Benchmark for Multi-Frame Image Restoration under Severe Refractive Warping

    arXiv:2605.05079v1 Announce Type: new Abstract: Video sequence capturing through refractive dynamic media, such as a turbulent air or water surface, often suffer from severe geometric distortions and temporal instability. While recent advances address mild atmospheric turbulence,…

  5. arXiv cs.CV TIER_1 English(EN) · Mun Wai Lee ·

    A unified Benchmark for Multi-Frame Image Restoration under Severe Refractive Warping

    Video sequence capturing through refractive dynamic media, such as a turbulent air or water surface, often suffer from severe geometric distortions and temporal instability. While recent advances address mild atmospheric turbulence, no existing benchmarks systematically evaluate …

  6. arXiv cs.CV TIER_1 English(EN) · Srinivas Soumitri Miriyala, Sowmya Vajrala, Sravanth Kodavanti, Vikram Nelvoy Rajendiran, Sharan Kumar Allur ·

    Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models

    arXiv:2605.02794v1 Announce Type: new Abstract: We propose a modular framework for hybrid image restoration that integrates transformer and state-space model (SSM) blocks with a focus on improving runtime efficiency on edge hardware. While transformers provide strong global model…

  7. arXiv cs.CV TIER_1 English(EN) · Lei He, Jielei Chu, Fengmao Lv, Weide Liu, Tianrui Li, Jun Cheng, Yuming Fang ·

    Degradation-Aware Adaptive Context Gating for Unified Image Restoration

    arXiv:2605.01236v1 Announce Type: new Abstract: Unified image restoration using a single model often faces task interference due to diverse degradations. To address this, we propose DACG-IR (Degradation-Aware Adaptive Context Gating), which enables explicit perception of degradat…

  8. arXiv cs.CV TIER_1 English(EN) · Sharan Kumar Allur ·

    Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models

    We propose a modular framework for hybrid image restoration that integrates transformer and state-space model (SSM) blocks with a focus on improving runtime efficiency on edge hardware. While transformers provide strong global modeling through self-attention, their attention kern…

  9. arXiv cs.CV TIER_1 English(EN) · Hebaixu Wang, Jing Zhang, Haoyang Chen, Haonan Guo, Di Wang, Jiayi Ma, Bo Du ·

    Residual Diffusion Bridge Model for Image Restoration

    arXiv:2510.23116v4 Announce Type: replace Abstract: Diffusion bridge models establish probabilistic paths between arbitrary paired distributions and exhibit great potential for universal image restoration. Most existing methods merely treat them as simple variants of stochastic i…