Explanation Generation for Contradiction Reconciliation with LLMs
Researchers have introduced a new task focused on generating explanations that reconcile contradictory statements, a capability crucial for human reasoning but underdeveloped in current large language models. They repurposed existing natural language inference datasets and developed new evaluation metrics to assess this ability. Experiments with 18 LLMs revealed limited success, with performance gains plateauing as model size increased, indicating a significant gap in LLM reasoning capabilities. AI