Researchers have developed TP-JSCC, a novel method for optimizing large vision-language models (LVLMs) in cloud-edge collaboration for 3D visual question answering (3D-VQA). The approach includes a Local and Global Semantics-based Hybrid Token Pruning (LGS-HTP) module that significantly reduces visual token count by decoupling foreground-background tokens and selecting critical semantics. Additionally, a Token Joint Source-Channel Coding (T-JSCC) module compresses these pruned tokens for robust transmission over error-prone channels, adapting to fluctuating conditions with minimal overhead. Experiments on ScanQA and SQA3D datasets demonstrate substantial data volume reduction and computational complexity savings. AI
IMPACT This method could enable more efficient deployment of advanced AI models on resource-constrained devices for complex visual tasks.
RANK_REASON The item is a research paper detailing a novel method for optimizing LVLMs. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →