OrderDP: A Theoretically Guaranteed Lossless Dynamic Data Pruning Framework
Researchers have introduced OrderDP, a new framework designed to accelerate AI model training by dynamically pruning data. This method aims to reduce training costs by over 40% while maintaining near-lossless performance and unbiased gradient estimation. OrderDP achieves this by first randomly selecting a data subset and then choosing the top-q samples, offering theoretical guarantees for convergence and generalization. The framework has been empirically validated on datasets like ImageNet-1K, demonstrating competitive accuracy and stable convergence. AI
IMPACT Reduces training costs by over 40% while maintaining performance, enabling more efficient AI development.