Researchers have developed a new method called Executable Causal Intervention for Demonstrations Distillation (ECI2D) to improve the quality of self-generated in-context learning demonstrations for large language models. Existing methods filter demonstrations based on observed correct outputs, which can include spurious rationales. ECI2D addresses this by abstracting rationales into executable programs and using causal interventions to ensure that these rationales remain effective across logically similar samples, a property known as transfer invariance. Experiments show that ECI2D significantly outperforms observational filtering methods, achieving higher accuracy with fewer demonstrations, particularly when the test distribution shifts. AI
IMPACT Enhances LLM reasoning capabilities by ensuring more robust and transferable in-context learning demonstrations.
RANK_REASON Academic paper detailing a new method for improving LLM in-context learning. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →