Researchers have introduced TRILOGUE, a new trilingual benchmark designed for fact-checking spoken dialogues in English, Russian, and Kazakh. This benchmark includes nearly 12,000 dialogues, over 187,000 turns, and 390 hours of paired audio with aligned transcripts. TRILOGUE supports multiple fact-checking tasks, including claim check-worthiness detection, evidence retrieval, and claim verification, and aims to address the challenges posed by Automatic Speech Recognition errors and cross-lingual transfer. AI
IMPACT Provides a new resource for developing and evaluating multilingual spoken dialogue fact-checking systems, addressing challenges in ASR and cross-lingual transfer.
RANK_REASON Publication of a new academic benchmark dataset on arXiv. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →