beyond-gradient optimization

New methods tackle catastrophic forgetting in continual learning · 8 sources tracked

Researchers are developing new methods to address catastrophic forgetting in continual learning, a challenge where models lose previously acquired knowledge when learning new tasks. Several papers propose novel techniqu…