Exact Federated Continual Unlearning for Ridge Heads on Frozen Foundation Models
Researchers have developed a novel method for federated continual unlearning, specifically designed for models with a frozen foundation and a trainable ridge-regression head. This approach allows for the exact removal of specific data influences from the model on demand, addressing the 'right to be forgotten' requirement in federated learning settings. The method utilizes a communication protocol that efficiently updates the model head with fixed-size messages, ensuring that the server's model is always identical to centralized retraining, even with continuous add and delete requests. Experiments on four benchmarks demonstrate that this technique achieves near-perfect accuracy, matching centralized retraining with minimal Frobenius error while significantly reducing computational costs compared to traditional federated retraining. AI
IMPACT Enables precise data removal in federated learning, enhancing privacy compliance for AI models.