CoMM benchmark

New Pareto LoRA method balances text and image gradients in multimodal models

Researchers have introduced Pareto LoRA, a novel method to address modality imbalance in unified multimodal models (UMMs) during parameter-efficient fine-tuning. This imbalance, particularly prevalent in LoRA-based tuni…