A new research paper published on arXiv details a phenomenon called CARLAR influence, where multimodal large language models (LLMs) incorrectly extract the same amount for both courtesy and legal fields on cheques, even when annotations differ or are blank. The study evaluated GPT-4.1 and Claude-4.5 Sonnet across various visual prompting conditions, finding that GPT-4.1 achieved 73.7% CARLAR influence under courtesy redaction. Researchers also tested a compressed-image few-shot intervention, which improved Claude's joint extraction accuracy by 11.5 percentage points but had a mixed effect on GPT-4.1, highlighting the need for validation methods that consider visual context and inter-field dependencies. AI
IMPACT Highlights a specific hallucination risk in LLMs for financial document extraction, necessitating improved validation methods.
RANK_REASON Research paper published on arXiv detailing a specific hallucination risk in LLMs. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →