Researchers have developed DICS, a novel method for selecting high-quality visual instruction data for training Vision-Language Models (VLMs). DICS utilizes a self-scoring metric called Data Intrinsic Consistency (DIC), which comprises Visual Information Consistency (VIC) and Response Information Consistency (RIC) modules. This approach optimizes the balance between intra-sample consistency and global diversity, significantly improving model performance with substantially less training data. Experiments show DICS outperforms existing methods, achieving performance close to full-dataset fine-tuning using only 25% of the data, and has been used to curate a 6M-sample corpus for large-scale studies. AI
IMPACT Enhances efficiency in training Vision-Language Models by reducing data requirements and improving performance.
RANK_REASON The cluster describes a new research paper detailing a novel method for data selection in AI model training.
Read on Hugging Face Daily Papers →
- Data Intrinsic Consistency
- DICS
- DICS-6M
- InternVL3-8B-Instruct
- LLaVA-1.5-665K
- Response Information Consistency
- Visual Information Consistency
- Richard
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →