PulseAugur
实时 23:16:51

New Linear-DPO method improves text-to-image model alignment

Researchers have introduced Linear-DPO, a novel method for aligning text-to-image generative models. This approach generalizes the Direct Preference Optimization objective to encompass both diffusion and flow-matching models within a unified framework. By replacing the standard sigmoid-based utility function with a linear one and incorporating an EMA-updated reference model, Linear-DPO demonstrates superior performance over existing methods on diffusion models like SD1.5 and SDXL, as well as the flow-matching model SD3-Medium. AI

影响 Introduces a more effective alignment technique for text-to-image models, potentially improving their adherence to user prompts.

排序理由 The cluster contains an academic paper detailing a new method for generative models. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.LG 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

New Linear-DPO method improves text-to-image model alignment

报道来源 [1]

  1. arXiv cs.LG TIER_1 English(EN) · Tao Lan ·

    Linear-DPO: Linear Direct Preference Optimization for Diffusion and Flow-Matching Generative Models

    Direct Preference Optimization (DPO) is successful for alignment in LLMs but still faces challenges in text-to-image generation. Existing studies are confined to denoising diffusion models while overlooking flow-matching, and suffer from an objective mismatch when applying discre…