OmniParseBench, an open benchmark for document parsers, has been implemented and analyzed. This benchmark evaluates parsers using 16,288 tests across various document types, including scanned forms, handwriting, and dense tables. The analysis involved rebuilding the leaderboard from released verdicts and testing Tesseract and Indra OCR on a sample of documents. Findings indicate that the top two parsers are statistically tied, rankings shift across different document types, and discrepancies were noted between launch figures and released files. AI
IMPACT Provides a framework for evaluating and comparing document parsing technologies, potentially driving improvements in OCR and document understanding.
RANK_REASON The item details the implementation and analysis of an open benchmark for document parsers, including testing specific OCR engines and evaluating performance across various document types. [lever_c_demoted from research: ic=1 ai=0.7]
- arXiv
- huggingface_hub
- Indra
- NumPy
- OmniParseBench
- onnxruntime
- opencv-python-headless
- pypdfium2
- Social Sciences DataLab
- Tesseract
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →