Researchers have introduced QAQ, a new framework for selecting high-quality synthetic data used to train code generation models. Unlike existing methods that assess how easily a model generates an answer from a query, QAQ evaluates how well an answer can predict the query. This bidirectional semantic coherence approach uses Reverse Mutual Information (RMI) to identify data that is both valid and challenging, reducing noise and hallucinations. Experiments show that selecting just 25% of data using QAQ can match full-data performance on code generation and math reasoning tasks, outperforming other data selection methods. AI
IMPACT This method could reduce computational costs for training AI models without sacrificing performance.
RANK_REASON The cluster contains an academic paper detailing a new method for synthetic data selection in AI. [lever_c_demoted from research: ic=1 ai=1.0]
- Instruction-Following Difficulty (IFD)
- Lei Jiayin
- Magpie-Qwen2.5-Coder-Pro-300K
- OpenR1-Math-220k
- QAQ
- Reverse Mutual Information (RMI)
- WarriorCoder
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →