AVA-Bench: Atomic Visual Ability Benchmark for Vision Foundation Models
Researchers have introduced AVA-Bench, a new benchmark designed to systematically evaluate vision foundation models (VFMs). This benchmark disentangles 14 foundational visual abilities, such as localization and spatial understanding, to pinpoint specific VFM weaknesses. AVA-Bench aims to move VFM selection from guesswork to principled engineering by providing a more transparent and comprehensive evaluation. The study also found that using a smaller LLM for evaluation can significantly reduce computational costs. AI
IMPACT Provides a more granular evaluation for vision foundation models, enabling more targeted development and selection.