VeriTaS: The First Dynamic Benchmark for Multimodal Automated Fact-Checking
Researchers have introduced VeriTaS, a novel dynamic benchmark designed to evaluate automated fact-checking systems for multimodal content. Unlike static benchmarks that can become compromised by large language model pretraining, VeriTaS is updated quarterly to ensure ongoing relevance. It currently includes 25,000 real-world claims in 54 languages, sourced from professional fact-checking organizations, and covers both text and audiovisual material. AI
IMPACT Provides a more robust evaluation framework for fact-checking systems, crucial for combating misinformation in the age of advanced LLMs.