New SPA method enhances CLIP-based class-incremental learning

Researchers have developed a new method called SPA (Semantic-guided Patch-level Alignment) to improve class-incremental learning using CLIP. This approach leverages local, patch-level features within CLIP's encoders, which were previously overlooked in favor of global image embeddings. SPA uses GPT-5 to generate semantic descriptions that guide the selection of discriminative visual patches, which are then aligned with these descriptions using optimal transport. The method also incorporates task-specific projectors and pseudo-feature calibration to combat catastrophic forgetting, achieving state-of-the-art results in experiments. AI

影响 Introduces a novel approach to leverage local features in vision-language models for continuous learning, potentially improving model adaptability.

排序理由 Academic paper introducing a novel method for class-incremental learning. [lever_c_demoted from research: ic=1 ai=1.0]

在 arXiv cs.CV 阅读 →

• arXiv
• GPT-5

• 论文
• 模型发布

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →