A new audit of 263 released batch-normalized checkpoints reveals that published unlearning numbers can shift between checkpoints, not due to surviving removed data, but because the checkpoint's properties change. Exchanging kept records for removed ones within a fixed fitting pool had minimal impact on a published cell. However, the degree to which a checkpoint's shipped state deviates from a refit does correlate with these shifts. The study suggests that for batch-normalized vision models, releases should specify the fitting convention alongside the reported numbers. AI
IMPACT Highlights potential issues in verifying AI model data removal, impacting trust and compliance in AI development.
RANK_REASON The cluster contains a research paper published on arXiv detailing an audit of AI model checkpoints. [lever_c_demoted from research: ic=1 ai=1.0]
- arXiv
- Batch-Normalization Statistics
- Batch-Normalized Checkpoints
- Fitting Pool
- Hugging Face
- Kept Data
- Removed Data
- Unlearning Numbers
- Vision Models
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →