AcquisitionSynthesis: Targeted Data Generation using Acquisition Functions
Researchers have developed a new method called AcquisitionSynthesis for generating high-quality synthetic data to train language models. This approach utilizes acquisition functions, typically used in active learning, to guide the data generation process, aiming to create samples that are more informative for downstream learners. Experiments show that models trained with AcquisitionSynthesis data achieve performance gains and exhibit greater robustness against catastrophic forgetting, while also demonstrating utility for training other models across different resource paradigms. AI
IMPACT This method could lead to more efficient and effective training of AI models by improving the quality and relevance of synthetic data.