Pool-Select-Refine: Allocation-Aware Generative Dataset Distillation with Soft-Label-Guided Latent Refinement
Researchers have introduced a new framework called Pool-Select-Refine for generative dataset distillation, a technique that condenses large datasets into smaller synthetic ones using diffusion models. This method improves upon existing approaches by first creating an over-complete pool of candidate samples and then selecting a subset within a specified budget. The selected samples are further refined in latent space using soft-label supervision to enhance semantic alignment and preserve generative qualities. AI
IMPACT This new framework could lead to more efficient and effective dataset distillation, potentially improving the training of AI models with smaller, curated synthetic datasets.