AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward
Researchers have introduced AlphaGRPO, a new framework designed to improve multimodal generation in Unified Multimodal Models (UMMs). This approach uses Group Relative Policy Optimization (GRPO) to enable models to perform advanced reasoning tasks like inferring user intent for text-to-image generation and self-correcting outputs. To provide better supervision, AlphaGRPO incorporates a Decompositional Verifiable Reward (DVReward) system, which breaks down user requests into verifiable questions evaluated by a general multimodal large language model (MLLM). Experiments show AlphaGRPO significantly enhances performance on various multimodal generation and editing benchmarks. AI
IMPACT Introduces a novel self-reflective reinforcement approach for multimodal models, potentially improving generation fidelity and user intent inference.