PulseAugur
EN
LIVE 14:04:23

LLMs improve NLI dataset error detection and model fine-tuning

A new framework called EVADE uses large language models (LLMs) to generate and validate explanations for error detection in natural language inference (NLI) datasets. This approach aims to reduce the cost and effort associated with traditional two-round human annotation methods. Experiments show that LLM-validated error removal improves NLI model fine-tuning performance more effectively than human-identified error removal, suggesting LLMs can enhance dataset quality and scalability. AI

IMPACT LLM-driven error detection can significantly improve the quality and reduce the cost of training data for NLP models.

RANK_REASON The cluster describes a new research paper proposing a novel framework for error detection in NLP datasets using LLMs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

LLMs improve NLI dataset error detection and model fine-tuning

COVERAGE [1]

  1. arXiv cs.CL TIER_1 English(EN) · Longfei Zuo, Barbara Plank, Siyao Peng ·

    EVADE: LLM-Based Explanation Generation and Validation for Error Detection in NLI

    arXiv:2511.08949v2 Announce Type: replace Abstract: High-quality datasets are critical for training and evaluating reliable NLP models. In tasks like natural language inference (NLI), human label variation (HLV) arises when multiple labels are valid for the same instance, making …