PulseAugur
实时 12:08:09
English(EN) Lens: Rethinking Training Efficiency for Foundational Text-to-Image Models

新的基准和数据集推动人工智能图像和视频生成

研究人员正在开发新的基准和数据集,以推动文本到图像和文本到视频生成模型的发展。一篇论文介绍了GPIC,一个用于视觉生成的庞大、许可宽松的图像语料库,另一篇论文提出了用于评估长篇、复杂文本到视频生成的LoCoT2V-Bench。此外,新的方法正在出现,用于评估文本到图像模型的公平性和对齐性,以及提高离散文本到图像生成的效率和质量。 AI

影响 新的数据集和评估框架将加速多模态人工智能生成的研究和开发,推动图像和视频合成的界限。

排序理由 多篇研究论文介绍了人工智能生成任务的新数据集、基准和评估方法。

在 Hugging Face Daily Papers 阅读 →

AI 生成摘要 · Google Gemini · 来自 37 个来源。 我们如何撰写摘要 →

新的基准和数据集推动人工智能图像和视频生成

报道来源 [37]

  1. arXiv cs.AI TIER_1 English(EN) · Yuwei Niu, Munan Ning, Mengren Zheng, Weiyang Jin, Bin Lin, Peng Jin, Jiaqi Liao, Chaoran Feng, Fanqing Meng, Kunpeng Ning, Bin Zhu, Li Yuan ·

    WISE:一个世界知识驱动的文本到图像生成语义评估方法

    arXiv:2503.07265v4 Announce Type: replace-cross Abstract: Text-to-Image (T2I) models are capable of generating high-quality artistic creations and visual content. However, existing research and evaluation standards predominantly focus on image realism and shallow text-image align…

  2. arXiv cs.LG TIER_1 English(EN) · Farbod Davoodi, Seyed Reza Tavakoli Shiyadeh, Pooria Safaei, Sana Harighi, Parsa Gholami, Amirali Amini, Kimia Vanaei, Emad Firoozi, Parham Abed Azad, Babak Khalaj, Siavash Ahmadi, Amir Hossein Payberah, Mohammad Hossein Rohban, Soheil Kolouri, Ali Diba ·

    KG-FairDiff:知识图谱引导的提示词精炼,实现人口统计学公平的文本到图像生成

    arXiv:2606.01282v1 Announce Type: cross Abstract: Text-to-Image (TTI) systems are now everyday infrastructure for journalism, education, advertising, and public communication, and the demographic and cultural stereotypes they inherit from training data (rendering women, people of…

  3. arXiv cs.AI TIER_1 English(EN) · Keshigeyan Chandrasegaran, Kyle Sargent, Suchir Agarwal, Michael Jang, Michael Poli, Juan Carlos Niebles, Justin Johnson, Jiajun Wu, Li Fei-Fei ·

    GPIC:一个用于视觉生成的巨型许可图像语料库

    arXiv:2605.30341v1 Announce Type: cross Abstract: Studying scalable methods for visual generative modeling requires large, accessible, and stable datasets. We introduce GPIC, a Giant Permissive Image Corpus of approximately 28 trillion pixels. GPIC comprises diverse internet imag…

  4. arXiv cs.AI TIER_1 English(EN) · Xiangqing Zheng, Chengyue Wu, Kehai Chen, Min Zhang ·

    LoCoT2V-Bench:长篇幅和复杂文本到视频生成的基准测试

    arXiv:2510.26412v3 Announce Type: replace-cross Abstract: Recent advances in text-to-video generation have achieved impressive performance on short clips, yet evaluating long-form generation under complex textual inputs remains a significant challenge. In response to this challen…

  5. arXiv cs.CL TIER_1 English(EN) · Blai Puchol, Sergio G\'omez Gonz\'alez, Miguel Domingo, Francisco Casacuberta ·

    面向含文本图像的机器翻译系统比较评估

    arXiv:2605.29476v1 Announce Type: new Abstract: This work presents a comparative evaluation of machine translation systems applied to images containing textual information, a task that lies at the intersection of computer vision and natural language processing. The study compares…

  6. arXiv cs.AI TIER_1 English(EN) · Li Fei-Fei ·

    GPIC:用于视觉生成的巨型许可图像语料库

    Studying scalable methods for visual generative modeling requires large, accessible, and stable datasets. We introduce GPIC, a Giant Permissive Image Corpus of approximately 28 trillion pixels. GPIC comprises diverse internet images captioned by a state-of-the-art vision-language…

  7. arXiv cs.AI TIER_1 English(EN) · Arian Komaei Koma, Seyed Amir Kasaei, AmirMahdi Sadeghzadeh, Mohammad Hossein Rohban ·

    已擦除但可利用:针对未学习文本到图像扩散模型的黑盒嵌入感知提示

    arXiv:2605.26332v1 Announce Type: cross Abstract: Machine unlearning aims to remove specific concepts from pretrained text-to-image diffusion models, yet several white- and black-box attacks have been introduced to make the model generate such unlearned concepts. These attacks, n…

  8. arXiv cs.LG TIER_1 English(EN) · Qingyu Shi, Jinbin Bai, Zhuoran Zhao, Wenhao Chai, Kaidong Yu, Jianzong Wu, Yunhai Tong, Xiangtai Li, Xuelong Li, Shuicheng Yan ·

    Muddit:用统一的离散扩散模型解放超越文本到图像的生成

    arXiv:2505.23606v5 Announce Type: replace Abstract: Unified generation models aim to handle diverse tasks across modalities -- such as text generation, image generation, and vision-language reasoning -- within a single architecture and decoding paradigm. Autoregressive unified mo…

  9. Hugging Face Daily Papers TIER_1 English(EN) ·

    通过区域感知双模态直接偏好优化进行组合文本到图像生成

    BiDPO enhances text-to-image models for complex compositional prompts through preference-based fine-tuning and region-level guidance.

  10. arXiv cs.LG TIER_1 English(EN) · Zahraa Al Sahili, Maimuna Nowaz, Maryam Fetanat, Ioannis Patras, Matthew Purver ·

    FairJudge:用于文本到图像模型公平性和对齐评估的、考虑弃权的模态间评判器

    arXiv:2510.22827v3 Announce Type: replace-cross Abstract: Evaluating text-to-image (T2I) systems requires judging not only whether an image matches a prompt, but also whether socially salient attributes are represented faithfully and without unsupported inference. Existing automa…

  11. Hugging Face Daily Papers TIER_1 English(EN) ·

    DyCoRM:用于文本到图像生成的动态标准感知奖励建模

    With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requirements. As reward models play an increasingly import…

  12. Hugging Face Daily Papers TIER_1 English(EN) ·

    Lens:重新思考基础文本到图像模型的训练效率

    Lens is a compact 3.8B-parameter text-to-image model achieving superior performance with reduced training compute through dense caption datasets, multi-resolution batching, efficient architecture, and optimization techniques.

  13. Hugging Face Daily Papers TIER_1 English(EN) ·

    RankE:面向离散文本到图像生成的端到端训练后优化与解码器协同演进

    Discrete autoregressive text-to-image models suffer from latent covariate shift during policy optimization, which RankE addresses through end-to-end co-evolution of policy and decoder components.

  14. arXiv cs.CV TIER_1 English(EN) · Piera Riccio, Miriam Doh, Benedikt H\"oltgen, Noa Garcia, Nanne van Noord ·

    Gender Artifacts from Art History to Text-to-Image Generation

    arXiv:2606.05829v1 Announce Type: new Abstract: Artistic styles are rooted in specific socio-historical contexts that encode social hierarchies, including distinct constructions of gender. Yet in AI research, style has long been treated as a surface-level visual property: a filte…

  15. arXiv cs.CV TIER_1 English(EN) · Nanne van Noord ·

    Gender Artifacts from Art History to Text-to-Image Generation

    Artistic styles are rooted in specific socio-historical contexts that encode social hierarchies, including distinct constructions of gender. Yet in AI research, style has long been treated as a surface-level visual property: a filter of color, brushstroke, and texture applied to …

  16. arXiv cs.CV TIER_1 English(EN) · Zeyuan Yang, Hao-Wei Chen, Xueyang Yu, Yuncong Yang, Haoyu Zhen, Ziqiao Ma, Maohao Shen, Chuang Gan ·

    UniCanvas:一种基于扩散的文本图像联合生成统一模型

    arXiv:2606.04264v1 Announce Type: new Abstract: Recent years have seen remarkable progress in unified vision-language models handling both multimodal understanding and generation within a single architecture. While autoregressive VLMs can reason across modalities, they fail to ge…

  17. arXiv cs.CV TIER_1 English(EN) · Wenshuo Chen, Kuimou Yu, Bowen Tian, Jianfei Song, Shaofeng Liang, Haozhe Jia, Kan Cheng, Haosen Li, Kaishen Yuan, Lei Wang, Jiemin Wu, Songning Lai, Yutao Yue ·

    MemoGen:过去的经验能否改善未来的文本到图像生成?

    arXiv:2606.03243v1 Announce Type: new Abstract: Modern text-to-image models have achieved strong visual synthesis, yet remain unreliable when prompts require implicit visual constraints, relational reasoning, or external knowledge. Existing retrieval-augmented and agentic generat…

  18. arXiv cs.CV TIER_1 English(EN) · Nurit Spingarn, Noa Cohen, Tamar Rott Shaham, Tomer Michaeli ·

    文本到图像模型比你想象的需要更少的文本编码器输入

    arXiv:2606.03715v1 Announce Type: new Abstract: Text-to-image models rely on text prompts as their primary interface to human intent. Prompts are encoded by a text encoder into embeddings that condition the image generation process. Beyond individual token meanings, text embeddin…

  19. arXiv cs.CV TIER_1 English(EN) · Tomer Michaeli ·

    文本到图像模型比你想象的需要更少的文本编码器输入

    Text-to-image models rely on text prompts as their primary interface to human intent. Prompts are encoded by a text encoder into embeddings that condition the image generation process. Beyond individual token meanings, text embeddings encode contextual information across the full…

  20. arXiv cs.CV TIER_1 English(EN) · Lexi Pang, Liheng Zhang, Hang Ye, Xiaoxuan Ma, Yizhou Wang ·

    RichControl:文本到图像生成的结构和外观丰富的无训练空间控制

    arXiv:2507.02792v5 Announce Type: replace Abstract: Text-to-image (T2I) diffusion models have shown remarkable success in generating high-quality images from text prompts. Recent efforts extend these models to incorporate conditional images (e.g., canny edge) for fine-grained spa…

  21. arXiv cs.CV TIER_1 English(EN) · Jiangweizhi Peng, Zhiwei Tang, Gaowen Liu, Charles Fleming, Mingyi Hong ·

    通过推理时提示噪声优化保护文本到图像生成

    arXiv:2412.03876v2 Announce Type: replace Abstract: Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating unsafe …

  22. arXiv cs.CV TIER_1 English(EN) · Jungmin Ko, Jungwon Park, Jimyeong Kim, Changin Choi, Wonseok Lee, Wonjong Rhee ·

    文本到图像生成中的注意力特征空间正交负向引导

    arXiv:2605.29390v1 Announce Type: new Abstract: Text-to-image (T2I) models have become increasingly capable of generating high-quality images. Yet, enforcing the explicit absence of a specified object or attribute remains a fundamentally challenging problem. Existing approaches, …

  23. arXiv cs.CV TIER_1 English(EN) · Yexin Liu, Wen-Jie Shu, Zile Huang, Haoze Zheng, Yueze Wang, Jingjin Zhu, Manyuan Zhang, Ser-Nam Lim, Harry Yang ·

    AlignVid:文本引导图像到视频生成中的无训练注意力缩放以实现语义保真度

    arXiv:2512.01334v2 Announce Type: replace Abstract: Text-guided image-to-video generation has made substantial progress, yet it still struggles to execute text-specified edits that require substantial changes to a reference image (\textit{e.g., object addition, removal, or modifi…

  24. arXiv cs.CV TIER_1 English(EN) · Zhiwei Zheng, Shibo Jin, Lingjie Liu, Mingmin Zhao ·

    用于文本到运动生成的下一尺度自回归模型

    arXiv:2604.03799v2 Announce Type: replace Abstract: Autoregressive (AR) models offer stable and efficient training, but standard next-token prediction is not well aligned with the temporal structure required for text-conditioned motion generation. We introduce MoScale, a next-sca…

  25. arXiv cs.CV TIER_1 English(EN) · Zhuohan Liu, Wujian Peng, Yitong Chen, Zuxuan Wu ·

    通过区域感知双模态直接偏好优化进行组合式文本到图像生成

    arXiv:2605.28615v1 Announce Type: new Abstract: Despite the rapid progress of text-to-image (T2I) models, generating images that accurately reflect complex compositional prompts (covering attribute bindings, object relationships, counting) still remains challenging. To address th…

  26. arXiv cs.CV TIER_1 English(EN) · Niantong Li, Guangzheng Hu, Weixu Qiao, Ying Ba, Qichen Hong, Shijun Shen, Jinlin Wang, Fan Zhou, Jianye Kang, Xin Shang, Ziyi He, Wei Wang, Dalin Li, Jiahao Li, Jie Zhang, Kaiyuan Gao, Kun Yan, Lihan Jiang, Ningyuan Tang, Shengming Yin, Tianhe Wu, Xiao … ·

    Qwen-Image-Bench:从生成到创作的文本到图像评估

    arXiv:2605.28091v1 Announce Type: new Abstract: Text-to-Image generation has evolved from basic image synthesis into a frequently used core capability in professional creative workflows, where simple text-image alignment can no longer satisfy users' pressing demands for faithful …

  27. arXiv cs.CV TIER_1 English(EN) · Zuxuan Wu ·

    通过区域感知双模态直接偏好优化进行组合式文本到图像生成

    Despite the rapid progress of text-to-image (T2I) models, generating images that accurately reflect complex compositional prompts (covering attribute bindings, object relationships, counting) still remains challenging. To address this, we propose BiDPO, a framework to enhance T2I…

  28. arXiv cs.CV TIER_1 English(EN) · Chenfei Wu ·

    Qwen-Image-Bench:从生成到创造的文本到图像评估

    Text-to-Image generation has evolved from basic image synthesis into a frequently used core capability in professional creative workflows, where simple text-image alignment can no longer satisfy users' pressing demands for faithful real-world reconstruction and genuine creative e…

  29. arXiv cs.CV TIER_1 English(EN) · Yaofang Liu, Kangning Cui, Meng Chu, Zhaoqing Li, Suiyun Zhang, Jean-Michel Morel, Xiaodong Cun, Haoxuan Che, Rui Liu, Raymond H. Chan ·

    超越文本提示:视觉到视觉生成作为统一范式

    arXiv:2605.12271v2 Announce Type: replace Abstract: Humans often specify and create through visual artifacts: typography sheets, sketches, reference images, and annotated scenes. Yet modern visual generators still ask users to serialize this intent into text, a bottleneck that co…

  30. arXiv cs.CV TIER_1 English(EN) · Jiaying Qian, Ziheng Jia, Qian Zhang, Zicheng Zhang, Jiayi Guo, Junqi Zhang, Guangtao Zhai, Xiongkuo Min ·

    DyCoRM:用于文本到图像生成的动态标准感知奖励建模

    arXiv:2605.25876v1 Announce Type: new Abstract: With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requiremen…

  31. arXiv cs.CV TIER_1 English(EN) · Shipeng Cao, Biao Qian, Haipeng Liu, Yang Wang, Meng Wang ·

    AI-T2I:聚合与隔离交叉注意力到扩散模型以实现文本到图像合成

    arXiv:2605.25763v1 Announce Type: new Abstract: Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps dur…

  32. arXiv cs.CV TIER_1 English(EN) · Shizhan Liu, Hao Zheng, Hang Yu, Jianguo Li ·

    ACCORD:通过依赖正则化缓解文本到图像扩散个性化的概念耦合

    arXiv:2503.01122v2 Announce Type: replace Abstract: Image personalization has garnered attention for its ability to customize Text-to-Image generation using only a few reference images. However, a key challenge in image personalization is the issue of conceptual coupling, where t…

  33. arXiv cs.CV TIER_1 English(EN) · Xiongkuo Min ·

    DyCoRM:用于文本到图像生成的动态标准感知奖励建模

    With the continued advancement of text-to-image (T2I) generation, producing high-quality images is becoming increasingly attainable; consequently, user demands are shifting toward images that better satisfy their specific requirements. As reward models play an increasingly import…

  34. arXiv cs.CV TIER_1 English(EN) · Meng Wang ·

    AI-T2I:聚合与隔离交叉注意力至扩散模型以实现文本到图像合成

    Text-to-image synthesis has made significant progress, benefiting from the strong generative capabilities of diffusion models. However, these models struggle to achieve precise text-to-image alignment within cross-attention maps during the denoising process. Existing works primar…

  35. arXiv cs.CV TIER_1 English(EN) · Yanjie Pan, Qingdong He, Zhengkai Jiang, Pengcheng Xu, Chaoyi Wang, Jinlong Peng, Haoxuan Wang, Yun Cao, Zhenye Gan, Mingmin Chi, Bo Peng, Yabiao Wang ·

    PixelPonder:动态补丁适应,增强多条件文本到图像生成

    arXiv:2503.06684v3 Announce Type: replace Abstract: Recent advances in diffusion-based text-to-image generation have demonstrated promising results through visual condition control. However, existing ControlNet-like methods struggle with compositional visual conditioning - simult…

  36. arXiv cs.CV TIER_1 English(EN) · Dong Chen, Fangyun Wei, Ziyu Wan, Dongdong Chen, Jiawei Zhang, Jinjing Zhao, Sirui Zhang, Yang Yue, Zhiyang Liang, Baining Guo, Chong Luo, Jianmin Bao, Ji Li, Lei Shi, Qinhong Yang, Xiuyu Wu, Xuelu Feng, Yan Lu, Yanchen Dong, Yitong Wang, Yunuo Chen ·

    Lens:重新思考基础文本到图像模型的训练效率

    arXiv:2605.21573v1 Announce Type: new Abstract: We introduce Lens, a 3.8B-parameter T2I model that achieves performance competitive with, and in several cases surpassing, state-of-the-art models with more than 6B parameters across various benchmarks, while requiring significantly…

  37. arXiv cs.CV TIER_1 English(EN) · Huan Wang ·

    RankE:用于离散文本到图像生成的端到端训练后模型,具有解码器协同演进

    Discrete autoregressive (AR) text-to-image (T2I) models pair a VQ tokenizer with an AR policy, and current post-training pipelines optimize only the policy while keeping the VQ decoder frozen. Recent diffusion T2I work, exemplified by REPA-E, has shown that the VAE itself constit…