Researchers have introduced Unlimited OCR 2, a novel document parsing model designed to handle documents of virtually unlimited length without prohibitive memory overhead. This model upgrades decoder attention modules to Sparse Reference Sliding Window Attention (SR-SWA), which maintains constant computational costs by limiting active reference tokens to a fixed capacity. This approach enables significant speedups, achieving 7.0x and 5.6x per-step improvements over Full Attention and R-SWA respectively on hundred-page documents. Unlimited OCR 2 also demonstrates state-of-the-art performance on MPDocBench and MarathonDocBench, new benchmarks specifically designed for parsing lengthy documents. AI
IMPACT Enables efficient parsing of extremely long documents, potentially transforming how large-scale document analysis and transcription are performed.
RANK_REASON The cluster describes a new research paper detailing a novel model architecture and benchmark for document parsing. [lever_c_demoted from research: ic=1 ai=1.0]
- Full Attention
- Jingjing Wu
- MarathonDocBench
- MPDocBench
- Sparse Reference Sliding Window Attention
- SR-SWA
- Unlimited-Horizon Decoding Paradigm
- Unlimited OCR 2
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →