Freeze-Nothing

New geometric framework for function-preserving continual learning unveiled

Researchers have introduced a novel function-preserving operator for continual learning called gate-zero growth. This method adds new residual blocks via a zero-initialized gate, which, under specific conditions, leads …