PulseAugur
实时 10:43:31
English(EN) PixRestore: Unified Image Restoration via Pixel Diffusion Transformer

PixRestore:无VAE的像素扩散Transformer用于图像修复

研究人员开发了PixRestore,一种利用无VAE的像素空间扩散Transformer的新型图像修复模型。与以往适配文本到图像模型的方法不同,PixRestore在补丁化像素上从头开始训练,保留了细粒度的细节并避免了内容不一致的伪影。该模型通过预测DINO特征相似性的特征可靠性,融合可靠的层特征作为条件,并监督不太可靠的层以去除退化,从而适应各种退化。PixRestore通过约5000万个参数和单步推理展示了高效率,与现有模型相比,实现了卓越的保真度和鲁棒性。 AI

影响 引入了一种更高效、更精细的图像修复方法,可能改进摄影、医学成像和媒体领域的应用。

排序理由 该集群描述了一篇关于用于图像修复的新型模型架构的详细新研究论文。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →

PixRestore:无VAE的像素扩散Transformer用于图像修复

报道来源 [3]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    PixRestore:通过像素扩散 Transformer 实现统一图像修复

    Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model. Most recent methods adapt large pretrained text-to-image (T2I) latent diffusion models for their strong capacity and generative…

  2. Hugging Face Daily Papers TIER_1 English(EN) ·

    PixRestore:通过像素扩散 Transformer 进行统一图像修复

    PixRestore is a compact, VAE-free pixel-space diffusion transformer trained from scratch for unified image restoration, using flow matching on patchified pixels, DINO-based reliability-guided feature fusion, and adversarial fine-tuning to a one-step generator for efficient high-f…

  3. arXiv cs.CV TIER_1 English(EN) · Lingchen Sun, Rongyuan Wu, Xiangtao Kong, Jixin Zhao, Qiaosi Yi, Yujing Sun, Shuaizheng Liu, Zhengqiang Zhang, Lei Zhang ·

    PixRestore:通过像素扩散 Transformer 实现统一图像修复

    arXiv:2608.16793v1 Announce Type: new Abstract: Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model. Most recent methods adapt large pretrained text-to-image (T2I) latent diffusion…