PulseAugur
LIVE 08:32:22
research · [2 sources] ·
0
research

New research analyzes machine unlearning in second-order optimizers

A new paper analyzes machine unlearning techniques, particularly for second-order optimizers, finding current definitions may be insufficient. The research compares first-order and second-order optimizers in data deletion tasks, noting that while both methods show performance and gradient alignment, second-order optimizers exhibit state volatility. This volatility suggests residual information that first-order analysis might miss, indicating a need for controlled state perturbation to fully erase geometric information. AI

Summary written by gemini-2.5-flash-lite from 2 sources. How we write summaries →

IMPACT Highlights potential gaps in current machine unlearning methods for advanced optimizers, suggesting new research directions for data privacy.

RANK_REASON Academic paper on machine unlearning techniques.

Read on arXiv stat.ML →

COVERAGE [2]

  1. arXiv stat.ML TIER_1 · Kennon Stewart ·

    Shape of Memory: a Geometric Analysis of Machine Unlearning in Second-Order Optimizers

    arXiv:2604.23046v1 Announce Type: cross Abstract: We argue that current definitions of machine unlearning are underspecified for second-order optimizers. We compare first-order and second-order learners for their ability to handle the data deletion task with varying degrees of ei…

  2. arXiv stat.ML TIER_1 · Kennon Stewart ·

    Shape of Memory: a Geometric Analysis of Machine Unlearning in Second-Order Optimizers

    We argue that current definitions of machine unlearning are underspecified for second-order optimizers. We compare first-order and second-order learners for their ability to handle the data deletion task with varying degrees of eigendecomposition to mimic the loss model memory. W…