A Comprehensive Survey of Knowledge-Based Vision Question Answering Systems: The Lifecycle of Knowledge in Visual Reasoning Task
Two new arXiv surveys offer comprehensive overviews of visual reasoning tasks in computer vision. The first paper details Knowledge-based Vision Question Answering (KB-VQA) systems, categorizing them by knowledge representation, retrieval, and reasoning, and highlighting the impact of large language models (LLMs) on the field. The second survey provides a taxonomy of visual reasoning, breaking it down into five types: relational, symbolic, temporal, causal, and commonsense, and examining various methodologies including LLMs and multimodal large language models (MLLMs). Both papers identify persistent challenges and outline future research directions for advancing these AI capabilities. AI
IMPACT These surveys consolidate current research, identify key challenges, and propose future directions for visual reasoning and knowledge-based VQA systems.