Researchers have identified a phenomenon called imbalanced forgetting in class-incremental learning, where some classes are forgotten more than others despite balanced rehearsal strategies. A new paper proposes three last-layer coefficients derived from gradient analysis to predict and explain this imbalanced forgetting. One coefficient, representing self-induced interference, appears to be the strongest predictor and is influenced by new-class interference. AI
IMPACT Provides a mechanistic account for imbalanced forgetting in CIL, suggesting new directions for model improvement.
RANK_REASON The cluster contains an academic paper detailing a new analysis of a machine learning phenomenon. [lever_c_demoted from research: ic=1 ai=1.0]
- Alberto Tamajo
- imbalanced forgetting
- last-layer coefficients
- new-class interference
- rehearsal
- self-induced interference
- class-incremental learning
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →