PulseAugur
EN
LIVE 16:45:53

Influence Matching advances dataset distillation by aligning training outcomes

Researchers have introduced Influence Matching (Inf-Match), a novel approach to dataset distillation that focuses on aligning the final training outcomes rather than intermediate processes. This method utilizes a differentiable, sample-level influence estimator that quantifies parameter shifts without complex calculations. Inf-Match has demonstrated superior accuracy on standard classification benchmarks, outperforming existing methods like NCFM on Tiny-ImageNet and scaling effectively to vision-language distillation tasks on Flickr30K. AI

IMPACT This new method for dataset distillation could lead to more efficient training of AI models by reducing the need for large datasets.

RANK_REASON The cluster contains an academic paper detailing a new method for dataset distillation. [lever_c_demoted from research: ic=1 ai=1.0]

Read on Hugging Face Daily Papers →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Influence Matching advances dataset distillation by aligning training outcomes

COVERAGE [1]

  1. Hugging Face Daily Papers TIER_1 English(EN) ·

    Dataset Distillation by Influence Matching

    We revisit dataset distillation from an outcome-centric perspective. Rather than aligning process surrogates (per-step gradients or training trajectories), Influence Matching (Inf-Match) aligns the final outcome of training: it learns a compact synthetic set whose effect on the c…